Residual Based Adaptive Coefficient and Noise Immunity ZNN for Perturbed Time Dependent Quadratic Minimization. The time dependent quadratic minimization (TDQM) problem appears in many applications and research projects. It has been reported that the zeroing neural network (ZNN) models can effectively solve the TDQM problem. However, the convergent and robust performance of the existing ZNN models are restricted for lack of a joint action mechanism of adaptive coefficient and integration enhanced term. Consequently, the residual based adaption coefficient zeroing neural network (RACZNN) model with integration term is proposed in this paper for solving the TDQM problem. The adaptive coefficient is proposed to improve the performance of convergence and the integration term is embedded to ensure the RACZNN model can maintain reliable robustness while perturbed by variant measurement noises. Compared with the state of the art models, the proposed RACZNN model owns faster convergence and more reliable robustness. Then, theorems are provided to prove the convergence of the RACZNN model. Finally, corresponding quantitative numerical experiments are designed and performed in this paper to verify the performance of the proposed RACZNN model.


A Probabilistically Motivated Learning Rate Adaptation for Stochastic Optimization. Machine learning practitioners invest significant manual and computational resources in finding suitable learning rates for optimization algorithms. We provide a probabilistic motivation, in terms of Gaussian inference, for popular stochastic first order methods. As an important special case, it recovers the Polyak step with a general metric. The inference allows us to relate the learning rate to a dimensionless quantity that can be automatically adapted during training by a control algorithm. The resulting meta algorithm is shown to adapt learning rates in a robust manner across a large range of initial values when applied to deep learning benchmark problems.


Learned Construction Grammars Converge Across Registers Given Increased Exposure. This paper measures the impact of increased exposure on whether learned construction grammars converge onto shared representations when trained on data from different registers. Register influences the frequency of constructions, with some structures common in formal but not informal usage. We expect that a grammar induction algorithm exposed to different registers will acquire different constructions. To what degree does increased exposure lead to the convergence of register specific grammars? The experiments in this paper simulate language learning in 12 languages (half Germanic and half Romance) with corpora representing three registers (Twitter, Wikipedia, Web). These simulations are repeated with increasing amounts of exposure, from 100k to 2 million words, to measure the impact of exposure on the convergence of grammars. The results show that increased exposure does lead to converging grammars across all languages. In addition, a shared core of register universal constructions remains constant across increasing amounts of exposure.


Essential dimension via prismatic cohomology. For X a smooth, proper complex variety such that h 0,i X neq 0, we show that for almost all primes p, the restriction of the mod p cohomology H i(X, mathbb F p) to any Zariski open is nonzero. The proof uses the prismatic cohomology of Bhatt Scholze. We use this result to obtain lower bounds on the p essential dimension of covers of complex varieties. For example, we prove the p incompressibility of the mod p homology cover of an abelian variety, confirming a conjecture of Brosnan for sufficiently large p. By combining these techniques with the theory of toroidal compactifications of Shimura varieties, we show that for any Hermitian symmetric domain X, there exist p congruence covers that are p incompressible.


Emerging chiral optics from chiral interfaces. Twisted atomic bilayers are emerging platforms for manipulating chiral light matter interaction at the extreme nanoscale, due to their inherent magnetoelectric responses induced by the finite twist angle and quantum interlayer coupling between the atomic layers. Recent studies have reported the direct correspondence between twisted atomic bilayers and chiral metasurfaces, which features a chiral surface conductivity, in addition to the electric and magnetic surface conductivities. However, far field chiral optics in light of these consitututive conductivities remains unexplored. Within the framework of the full Maxwell equations, we find that the chiral surface conductivity can be exploited to realize perfect polarization transformation between linearly polarized light. Remarkably, such an exotic chiral phenomenon can occur either for the reflected or transmitted light.


Model Based Single Image Deep Dehazing. Model based single image dehazing algorithms restore images with sharp edges and rich details at the expense of low PSNR values. Data driven ones restore images with high PSNR values but with low contrast, and even some remaining haze. In this paper, a novel single image dehazing algorithm is introduced by fusing model based and data driven approaches. Both transmission map and atmospheric light are initialized by the model based methods, and refined by deep learning approaches which form a neural augmentation. Haze free images are restored by using the transmission map and atmospheric light. Experimental results indicate that the proposed algorithm can remove haze well from real world and synthetic hazy images.


A Tensor SVD based Classification Algorithm Applied to fMRI Data. To analyze the abundance of multidimensional data, tensor based frameworks have been developed. Traditionally, the matrix singular value decomposition (SVD) is used to extract the most dominant features from a matrix containing the vectorized data. While the SVD is highly useful for data that can be appropriately represented as a matrix, this step of vectorization causes us to lose the high dimensional relationships intrinsic to the data. To facilitate efficient multidimensional feature extraction, we utilize a projection based classification algorithm using the t SVDM, a tensor analog of the matrix SVD. Our work extends the t SVDM framework and the classification algorithm, both initially proposed for tensors of order 3, to any number of dimensions. We then apply this algorithm to a classification task using the StarPlus fMRI dataset. Our numerical experiments demonstrate that there exists a superior tensor based approach to fMRI classification than the best possible equivalent matrix based approach. Our results illustrate the advantages of our chosen tensor framework, provide insight into beneficial choices of parameters, and could be further developed for classification of more complex imaging data. We provide our Python implementation at https github.com elizabethnewman tensor fmri.


fAshIon after fashion A Report of AI in Fashion. In this independent report fAshIon after fashion, we examine the development of fAshIon (artificial intelligence (AI) in fashion) and explore its potentiality to become a major disruptor of the fashion industry in the near future. To do this, we investigate AI technologies used in the fashion industry through several lenses. We summarise fAshIon studies conducted over the past decade and categorise them into seven groups Overview, Evaluation, Basic Tech, Selling, Styling, Design, and Buying. The datasets mentioned in fAshIon research have been consolidated on one GitHub page for ease of use. We analyse the authors' backgrounds and the geographic regions treated in these studies to determine the landscape of fAshIon research. The results of our analysis are presented with an aim to provide researchers with a holistic view of research in fAshIon. As part of our primary research, we also review a wide range of cases of applied fAshIon in the fashion industry and analyse their impact on the industry, markets and individuals. We also identify the challenges presented by fAshIon and suggest that these may form the basis for future research. We finally exhibit that many potential opportunities exist for the use of AI in fashion which can transform the fashion industry embedded with AI technologies and boost profits.


Understanding the Evolution of Blockchain Ecosystems A Longitudinal Measurement Study of Bitcoin, Ethereum, and EOSIO. The continuing expansion of the blockchain ecosystems has attracted much attention from the research community. However, although a large number of research studies have been proposed to understand the diverse characteristics of individual blockchain systems (e.g., Bitcoin or Ethereum), little is known at a comprehensive level on the evolution of blockchain ecosystems at scale, longitudinally, and across multiple blockchains. We argue that understanding the dynamics of blockchain ecosystems could provide unique insights that cannot be achieved through studying a single static snapshot or a single blockchain network alone. Based on billions of transaction records collected from three representative and popular blockchain systems (Bitcoin, Ethereum and EOSIO) over 10 years, we conduct the first study on the evolution of multiple blockchain ecosystems from different perspectives. Our exploration suggests that, although the overall blockchain ecosystem shows promising growth over the last decade, a number of worrying outliers exist that have disrupted its evolution.


HandFoldingNet A 3D Hand Pose Estimation Network Using Multiscale Feature Guided Folding of a 2D Hand Skeleton. With increasing applications of 3D hand pose estimation in various human computer interaction applications, convolution neural networks (CNNs) based estimation models have been actively explored. However, the existing models require complex architectures or redundant computational resources to trade with the acceptable accuracy. To tackle this limitation, this paper proposes HandFoldingNet, an accurate and efficient hand pose estimator that regresses the hand joint locations from the normalized 3D hand point cloud input. The proposed model utilizes a folding based decoder that folds a given 2D hand skeleton into the corresponding joint coordinates. For higher estimation accuracy, folding is guided by multi scale features, which include both global and joint wise local features. Experimental results show that the proposed model outperforms the existing methods on three hand pose benchmark datasets with the lowest model parameter requirement. Code is available at https github.com cwc1260 HandFold.


You can't always get what you want towards user controlled privacy on Android. Mobile applications (hereafter, apps) collect a plethora of information regarding the user behavior and his device through third party analytics libraries. However, the collection and usage of such data raised several privacy concerns, mainly because the end user i.e., the actual owner of the data is out of the loop in this collection process. Also, the existing privacy enhanced solutions that emerged in the last years follow an "all or nothing" approach, leaving the user the sole option to accept or completely deny the access to privacy related data. This work has the two fold objective of assessing the privacy implications on the usage of analytics libraries in mobile apps and proposing a data anonymization methodology that enables a trade off between the utility and privacy of the collected data and gives the user complete control over the sharing process. To achieve that, we present an empirical privacy assessment on the analytics libraries contained in the 4500 most used Android apps of the Google Play Store between November 2020 and January 2021. Then, we propose an empowered anonymization methodology, based on MobHide, that gives the end user complete control over the collection and anonymization process. Finally, we empirically demonstrate the applicability and effectiveness of such anonymization methodology thanks to HideDroid, a fully fledged anonymization app for the Android ecosystem.


Stochastic Control Problems with Unbounded Control Operators solutions through generalized derivatives. This paper deals with a family of stochastic control problems in Hilbert spaces which arises in typical applications (such as boundary control and control of delay equations with delay in the control) and for which is difficult to apply the dynamic programming approach due to the unboudedness of the control operator and to the lack of regularity of the underlying transition semigroup. We introduce a specific concept of partial derivative, designed for this situation, and we develop a method to prove that the associated HJB equation has a solution with enough regularity to find optimal controls in feedback form.


Machine in the Loop Rewriting for Creative Image Captioning. Machine in the loop writing aims to enable humans to collaborate with models to complete their writing tasks more effectively. Prior work has found that providing humans a machine written draft or sentence level continuations has limited success since the generated text tends to deviate from humans' intention. To allow the user to retain control over the content, we train a rewriting model that, when prompted, modifies specified spans of text within the user's original draft to introduce descriptive and figurative elements locally in the text. We evaluate the model on its ability to collaborate with humans on the task of creative image captioning. On a user study through Amazon Mechanical Turk, our model is rated to be more helpful than a baseline infilling language model. In addition, third party evaluation shows that users write more descriptive and figurative captions when collaborating with our model compared to completing the task alone.


Circular Dichroism in Atomic Resonance Enhanced Few Photon Ionization. We investigate few photon ionization of lithium atoms prepared in the polarized 2 p ( m ell ! 1 ) state when subjected to femtosecond light pulses with left or right handed circular polarization at wavelengths between 665 nm and 920 nm. We consider whether ionization proceeds more favorably for the electric field co or counter rotating with the initial electronic current density. Strong asymmetries are found and quantitatively analyzed in terms of "circular dichroism" ( CD ). While the intensity dependence of the measured CD values is rather weak throughout the investigated regime, a very strong sensitivity on the center wavelength of the incoming radiation is observed. While the co rotating situation overall prevails, the counter rotating geometry is strongly favored around 800 nm due to the 2 p 3 s resonant transition, which can only be driven by counter rotating fields. The observed features provide insights into the helicity dependence of light atom interactions, and on the possible control of electron emission in atomic few photon ionization by polarization selective resonance enhancement.


A constant pressure flowmeter for extremely high vacuum. We demonstrate operation of a constant pressure flowmeter capable of generating and accurately measuring flows as low as 2 times10 13 mol s. Generation of such small flows is accomplished by using a small conductance element with C approx 50 nL s. Accurate measurement then requires both low outgassing materials ( 10 15 mol s) and small volume changes ( approx 70 mu L). We outline the present flowmeter's construction, detail its operation, and quantify its uncertainty. The type B uncertainty is 0.2 ( k 1 ) over the entire operating range. In particular, we present an analysis of its hydraulic system, and quantify the shift and uncertainty due to the slightly compressible oil. Finally, we compare our flowmeter against a NIST standard flowmeter, and find agreement to within 0.5 ( k 2 ).


Kilo Tesla axial magnetic field generation with high intensity spin and orbital angular momentum beams. Absorption of angular momentum from a high intensity laser pulse can lead to the generation of strong axial magnetic fields in plasma. The effect, known as the inverse Faraday effect can generate kilo Tesla strength, multi picosecond, axial magnetic fields extending over hundreds of microns in underdense plasma. In this paper we explore the effect with ultra high intensity circularly polarized Gaussian beams and linearly polarized orbital angular momentum beams comparing analytic expressions with 3D particle in cell simulations. We develop a model for the transverse magnetic field profiles, introduce a new model for the temporal decay, and show that while the magnetic field strength is independent of plasma density, it has a strong dependence on the laser beam waist.


Wages and Utilities in a Closed Economy A StrategicAnalysis. The broad objective of this paper is to initiate through a mathematical model, the study of causes of wage inequality and relate it to choices of consumption and the technologies of production in an economy. The paper constructs a simple Heterodox Model of a closed economy, in which the consumption and the production parts are clearly separated and yet coupled through a tatonnement process. The equilibria of this process correspond directly with those of a related Arrow Debreu model. The formulation allows us to identify the combinatorial data which link parameters of the economic system with its equilibria, in particular, the impact of consumer preferences on wages. The Heterodox model also allows the formulation and explicit construction of the consumer choice game, where individual utilities serve as the strategies with total or relative wages as the pay offs. We illustrate, through two examples, the mathematical details of the consumer choice game. We show that consumer preferences, expressed through modified utility functions, do indeed percolate through the economy, and influences not only prices but also production and wages. Thus, consumer choice may serve as an effective tool for wage redistribution.


Investigation of the dynamics of inner gas during bursting of a bubble at the free surface. In the present study, simulations are directed to capture the dynamics of evacuating inner gas of a bubble bursting at the free surface, using Eulerian based volume of fluid (VOF) method. The rate by which surrounding air rushing inside the bubble cavity through the inner gas evacuation is estimated and compared by the collapsing bubble cavity during the sequential stages of the bubble bursting at the free surface. Further, the reachability of inner gas over the free surface is evaluated by establishing the comparison of the same through various horizontal planes, lying at different altitudes above the unperturbed surface. The evacuating inner gas accompanies vortex rings, which entrains the surrounding gas phase. During the successive stages of air entrainment, spatiotemporal characteristics of the vortex ring are obtained. At low Bond numbers ( 1), after comparing the phase contours of evacuating inner gas from the bubble cavity, the consequences at the axial growth of gas jet and the radial expansion of the jet tip is discussed separately. Furthermore, under the respiration process, the axial growth of rising inner gas over the free surface and the radial expansion of vortex rings of a bubble bursting at the free surface is compared with the quiescent surrounding air. At last, the effects of various possible asymmetric perforation of the bubble cap keeping the same Bo are studied. The cause of bent gas jet, as a consequence of perforation of the bubble cap, asymmetrically, is explained by plotting the velocity vectors.


Electrons on a straight path A novel ionisation vacuum gauge suitable as reference standard. The consortium of the European project 16NRM05 designed a novel ionisation vacuum gauge in which the electrons take a straight path from the emitting cathode through the ionisation space into a Faraday cup. Compared to existing ionisation vacuum gauges, this has the advantage that the electron path length is well defined. It is independent of the point and angle of emission and is not affected by space charge around the collector. In addition, the electrons do not hit the anode where they can be reflected, generate secondary electrons or cause desorption of neutrals or ions. This design was chosen in order to develop a more stable ionisation vacuum gauge suitable as reference standard in the range of 10 6 Pa to 10 2 Pa for calibration purposes of other vacuum gauges and quadrupole mass spectrometers. Prototype gauges were produced by two different manufacturers and showed predictable sensitivities with a very small spread ( 1.5 ), very good short term repeatability ( 0.05 ) and reproducibility ( 1 ), even after changing the emission cathode and drop down tests. These characteristics make the gauge also attractive for industrial applications, because a gauge exchange does not require calibration or re adjustment of a process.


On maximal green sequence for quivers arising from weighted projective lines. We investigate the existence and non existence of maximal green sequences for quivers arising from weighted projective lines. Let Q be the Gabreil quiver of the endomorphism algebra of a basic cluster tilting object in the cluster category mathcal C mathbb X of a weighted projective line mathbb X . It is proved that there exists a quiver Q' in the mutation equivalence class operatorname Mut (Q) such that Q' admits a maximal green sequence. On the other hand, there is a quiver in operatorname Mut (Q) which does not admit a maximal green sequence if and only if mathbb X is of wild type.


Co evolution of platform architecture, platform services, and platform governance Expanding the platform value of industrial digital platforms. Industrial manufacturers increasingly develop digital platforms in the business to business (B2B) context. This emergent form of digital platforms requires a profound yet little understood holistic perspective that encompasses the co evolution of platform architecture, platform services, and platform governance. To address this research gap, our study examines multiple platform sponsors from an industrial manufacturing context. The study demarcates three platform archetypes product platform, supply chain platform, and platform ecosystem. We argue that each platform archetype involves a gradual development of platform architecture, platform services, and platform governance, which mirror each other. We also find that each platform archetype is characterized by a specific innovation mechanism that contributes to the platform service discovery and expands the platform value. Our study extends the co evolution perspective of platform ecosystem literature and digital servitization literature.


FIRESTARTER 2 Dynamic Code Generation for Processor Stress Tests. Processor stress tests target to maximize processor power consumption by executing highly demanding workloads. They are typically used to test the cooling and electrical infrastructure of compute nodes or larger systems in labs or data centers. While multiple of these tools already exists, they have to be re evaluated and updated regularly to match the developments in computer architecture. This paper presents the first major update of FIRESTARTER, an Open Source tool specifically designed to create near peak power consumption. The main new features concern the online generation of workloads and automatic self tuning for specific hardware configurations. We further apply these new features on an AMD Rome system and demonstrate the optimization process. Our analysis shows how accesses to the different levels of the memory hierarchy contribute to the overall power consumption. Finally, we demonstrate how the auto tuning algorithm can cope with different processor configurations and how these influence the effectiveness of the created workload.


Embracing Structure in Data for Billion Scale Semantic Product Search. We present principled approaches to train and deploy dyadic neural embedding models at the billion scale, focusing our investigation on the application of semantic product search. When training a dyadic model, one seeks to embed two different types of entities (e.g., queries and documents or users and movies) in a common vector space such that pairs with high relevance are positioned nearby. During inference, given an embedding of one type (e.g., a query or a user), one seeks to retrieve the entities of the other type (e.g., documents or movies, respectively) that are highly relevant. In this work, we show that exploiting the natural structure of real world datasets helps address both challenges efficiently. Specifically, we model dyadic data as a bipartite graph with edges between pairs with positive associations. We then propose to partition this network into semantically coherent clusters and thus reduce our search space by focusing on a small subset of these partitions for a given input. During training, this technique enables us to efficiently mine hard negative examples while, at inference, we can quickly find the nearest neighbors for a given embedding. We provide offline experimental results that demonstrate the efficacy of our techniques for both training and inference on a billion scale Amazon.com product search dataset.


Nonlinear circular dichroism in Mie resonant nanoparticle dimers. We study nonlinear response of a dimer composed of two identical Mie resonant dielectric nanoparticles illuminated normally by a circularly polarized light. We develop a general theory describing hybridization of multipolar modes of the coupled nanoparticles, and reveal nonvanishing nonlinear circular dichroism (CD) in the second harmonic generation (SHG) signal enhanced by the multipolar resonances in the dimer provided its axis is oriented under an angle to the crystalline lattice of the dielectric material. We present experimental results for this SHG CD effect obtained for the AlGaAs dimers placed on an engineered substrate which confirm the basic prediction of our general multipolar hybridization theory.


How Far Should We Look Back to Achieve Effective Real Time Time Series Anomaly Detection?. Anomaly detection is the process of identifying unexpected events or ab normalities in data, and it has been applied in many different areas such as system monitoring, fraud detection, healthcare, intrusion detection, etc. Providing real time, lightweight, and proactive anomaly detection for time series with neither human intervention nor domain knowledge could be highly valuable since it reduces human effort and enables appropriate countermeasures to be undertaken before a disastrous event occurs. To our knowledge, RePAD (Real time Proactive Anomaly Detection algorithm) is a generic approach with all above mentioned features. To achieve real time and lightweight detection, RePAD utilizes Long Short Term Memory (LSTM) to detect whether or not each upcoming data point is anomalous based on short term historical data points. However, it is unclear that how different amounts of historical data points affect the performance of RePAD. Therefore, in this paper, we investigate the impact of different amounts of historical data on RePAD by introducing a set of performance metrics that cover novel detection accuracy measures, time efficiency, readiness, and resource consumption, etc. Empirical experiments based on real world time series datasets are conducted to evaluate RePAD in different scenarios, and the experimental results are presented and discussed.


Propagating Visual Designs to Numerous Plots and Dashboards. In the process of developing an infrastructure for providing visualization and visual analytics (VIS) tools to epidemiologists and modeling scientists, we encountered a technical challenge for applying a number of visual designs to numerous datasets rapidly and reliably with limited development resources. In this paper, we present a technical solution to address this challenge. Operationally, we separate the tasks of data management, visual designs, and plots and dashboard deployment in order to streamline the development workflow. Technically, we utilize an ontology to bring datasets, visual designs, and deployable plots and dashboards under the same management framework multi criteria search and ranking algorithms for discovering potential datasets that match a visual design and a purposely design user interface for propagating each visual design to appropriate datasets (often in tens and hundreds) and quality assuring the propagation before the deployment. This technical solution has been used in the development of the RAMPVIS infrastructure for supporting a consortium of epidemiologists and modeling scientists through visualization.


BIPS Bi modal Indoor Panorama Synthesis via Residual Depth aided Adversarial Learning. Providing omnidirectional depth along with RGB information is important for numerous applications, eg, VR AR. However, as omnidirectional RGB D data is not always available, synthesizing RGB D panorama data from limited information of a scene can be useful. Therefore, some prior works tried to synthesize RGB panorama images from perspective RGB images however, they suffer from limited image quality and can not be directly extended for RGB D panorama synthesis. In this paper, we study a new problem RGB D panorama synthesis under the arbitrary configurations of cameras and depth sensors. Accordingly, we propose a novel bi modal (RGB D) panorama synthesis (BIPS) framework. Especially, we focus on indoor environments where the RGB D panorama can provide a complete 3D model for many applications. We design a generator that fuses the bi modal information and train it with residual aided adversarial learning (RDAL). RDAL allows to synthesize realistic indoor layout structures and interiors by jointly inferring RGB panorama, layout depth, and residual depth. In addition, as there is no tailored evaluation metric for RGB D panorama synthesis, we propose a novel metric to effectively evaluate its perceptual quality. Extensive experiments show that our method synthesizes high quality indoor RGB D panoramas and provides realistic 3D indoor models than prior methods. Code will be released upon acceptance.


Robust Online Control with Model Misspecification. We study online control of an unknown nonlinear dynamical system that is approximated by a time invariant linear system with model misspecification. Our study focuses on robustness, a measure of how much deviation from the assumed linear approximation can be tolerated by a controller while maintaining finite ell 2 gain. A basic methodology to analyze robustness is via the small gain theorem. However, as an implication of recent lower bounds on adaptive control, this method can only yield robustness that is exponentially small in the dimension of the system and its parametric uncertainty. The work of Cusumano and Poolla shows that much better robustness can be obtained, but the control algorithm is inefficient, taking exponential time in the worst case. In this paper we investigate whether there exists an efficient algorithm with provable robustness beyond the small gain theorem. We demonstrate that for a fully actuated system, this is indeed attainable. We give an efficient controller that can tolerate robustness that is polynomial in the dimension and independent of the parametric uncertainty furthermore, the controller obtains an ell 2 gain whose dimension dependence is near optimal.


Effective Cascade Dual Decoder Model for Joint Entity and Relation Extraction. Extracting relational triples from texts is a fundamental task in knowledge graph construction. The popular way of existing methods is to jointly extract entities and relations using a single model, which often suffers from the overlapping triple problem. That is, there are multiple relational triples that share the same entities within one sentence. In this work, we propose an effective cascade dual decoder approach to extract overlapping relational triples, which includes a text specific relation decoder and a relation corresponded entity decoder. Our approach is straightforward the text specific relation decoder detects relations from a sentence according to its text semantics and treats them as extra features to guide the entity extraction for each extracted relation, which is with trainable embedding, the relation corresponded entity decoder detects the corresponding head and tail entities using a span based tagging scheme. In this way, the overlapping triple problem is tackled naturally. Experiments on two public datasets demonstrate that our proposed approach outperforms state of the art methods and achieves better F1 scores under the strict evaluation metric. Our implementation is available at https github.com prastunlp DualDec.


Ultrafast Multi Shot Ablation and Defect Generation in Monolayer Transition Metal Dichalcogenides. Transition metal dichalcogenides are known to possess large optical nonlinearities and driving these materials at high intensities is desirable for many applications. Understanding their optical responses under repetitive intense excitation is essential to improve the performance limit of these strong field devices and to achieve efficient laser patterning. Here, we report the incubation study of monolayer MoS 2 and WS 2 induced by 160 fs, 800 nm pulses in air to examine how their ablation threshold scales with the number of admitted laser pulses. Both materials were shown to outperform graphene and most bulk materials specifically, MoS 2 is as resistant to radiation degradation as the best of the bulk thin films with a record fast saturation. Our modeling provides convincing evidence that the small reduction in threshold and fast saturation of MoS 2 originates in its excellent bonding integrity against radiation induced softening. Sub ablation damages, in the forms of vacancies, lattice disorder, and nano voids, were revealed by transmission electron microscopy, photoluminescence, Raman, and second harmonic generation studies, which were attributed to the observed incubation. For the first time, a sub ablation damage threshold is identified for monolayer MoS 2 to be 78 of single shot ablation threshold, below which MoS 2 remains intact for many laser pulses. Our results firmly establish MoS 2 as a robust material for strong field devices and for high throughput laser patterning.


Joint Sampling and Transmission Policies for Minimizing Cost under AoI Constraints. In this work, we consider the problem of jointly minimizing the average cost of sampling and transmitting status updates by users over a wireless channel subject to average Age of Information (AoI) constraints. Errors in the transmission may occur and a scheduling policy has to decide if the users sample a new packet or attempt for retransmission of the packet sampled previously. The cost consists of both sampling and transmission costs. The sampling of a new packet after a failure imposes an additional cost on the system. We formulate a stochastic optimization problem with the average cost in the objective under average AoI constraints. To solve this problem, we propose three scheduling policies a) a dynamic policy, that is centralized and requires full knowledge of the state of the system, b) two stationary randomized policies that require no knowledge of the state of the system. We utilize tools from Lyapunov optimization theory in order to provide the dynamic policy, and we prove that its solution is arbitrary close to the optimal one. In order to provide the randomized policies, we model the system by utilizing Discrete Time Markov Chain (DTMC). We provide closed form and approximated expressions for the average AoI and its distribution, for each randomized policy. Simulation results show the importance of providing the option to transmit an old packet in order to minimize the total average cost.


NLP CUET LT EDI EACL2021 Multilingual Code Mixed Hope Speech Detection using Cross lingual Representation Learner. In recent years, several systems have been developed to regulate the spread of negativity and eliminate aggressive, offensive or abusive contents from the online platforms. Nevertheless, a limited number of researches carried out to identify positive, encouraging and supportive contents. In this work, our goal is to identify whether a social media post comment contains hope speech or not. We propose three distinct models to identify hope speech in English, Tamil and Malayalam language to serve this purpose. To attain this goal, we employed various machine learning (support vector machine, logistic regression, ensemble), deep learning (convolutional neural network long short term memory) and transformer (m BERT, Indic BERT, XLNet, XLM Roberta) based methods. Results indicate that XLM Roberta outdoes all other techniques by gaining a weighted f 1 score of 0.93 , 0.60 and 0.85 respectively for English, Tamil and Malayalam language. Our team has achieved 1 st , 2 nd and 1 st rank in these three tasks respectively.


Boosting Semi Supervised Face Recognition with Noise Robustness. Although deep face recognition benefits significantly from large scale training data, a current bottleneck is the labelling cost. A feasible solution to this problem is semi supervised learning, exploiting a small portion of labelled data and large amounts of unlabelled data. The major challenge, however, is the accumulated label errors through auto labelling, compromising the training. This paper presents an effective solution to semi supervised face recognition that is robust to the label noise aroused by the auto labelling. Specifically, we introduce a multi agent method, named GroupNet (GN), to endow our solution with the ability to identify the wrongly labelled samples and preserve the clean samples. We show that GN alone achieves the leading accuracy in traditional supervised face recognition even when the noisy labels take over 50 of the training data. Further, we develop a semi supervised face recognition solution, named Noise Robust Learning Labelling (NRoLL), which is based on the robust training ability empowered by GN. It starts with a small amount of labelled data and consequently conducts high confidence labelling on a large amount of unlabelled data to boost further training. The more data is labelled by NRoLL, the higher confidence is with the label in the dataset. To evaluate the competitiveness of our method, we run NRoLL with a rough condition that only one fifth of the labelled MSCeleb is available and the rest is used as unlabelled data. On a wide range of benchmarks, our method compares favorably against the state of the art methods.


Inclusions of C algebras arising from fixed point algebras. We examine inclusions of C algebras of the form A H subseteq A rtimes r G , where G and H are groups acting on a unital simple C algebra A by outer automorphisms and H is finite. It follows from a theorem of Izumi that A H subseteq A is C irreducible, in the sense that all intermediate C algebras are simple. We show that A H subseteq A rtimes r G is C irreducible for all G and H as above if and only if G and H have trivial intersection in the outer automorphisms of A , and we give a Galois type classification of all intermediate C algebras in the case when H is abelian and the two actions of G and H on A commute. We illustrate these results with examples of outer group actions on the irrational rotation C algebras. We exhibit, among other examples, C irreducible inclusions of AF algebras that have intermediate C algebras that are not AF algebras, in fact, the irrational rotation C algebra appears as an intermediate C algebra.


Parallelized sequential composition, pipelines, and hardware weak memory models. Since the introduction of the CDC 6600 in 1965 and its scoreboarding' technique processors have not (necessarily) executed instructions in program order. Programmers of high level code may sequence independent instructions in arbitrary order, and it is a matter of significant programming abstraction and computational efficiency that the processor can be relied upon to make sensible parallelizations reorderings of low level instructions to take advantage of, eg., multiple ALUs. At the architectural level such reordering is typically implemented via a per processor pipeline, into which instructions are fetched in order, but possibly committed out of order depending on local considerations, provided any reordering preserves sequential semantics from that processor's perspective. However multicore architectures, where several pipelines run in parallel, can expose these processor level reorderings as unexpected, or weak', behaviours. Such weak behaviours are hard to reason about, and (via speculative execution) underlie at least one class of widespread security vulnerability. In this paper we introduce a novel program operator, emph parallelized sequential composition , which can be instantiated with a function that controls the reordering of atomic instructions. It generalises both sequential and parallel composition, and when appropriately instantiated exhibits many of the weak behaviours of well known hardware weak memory models. Our framework admits the application of established compositional techniques (eg. Owicki Gries) for reasoning about weak behaviours, and is convenient for abstractly expressing properties from the literature. The semantics and theory is encoded and verified in a theorem prover, and we give an implementation of the pipeline semantics which we use to empirically show conformance against established models of ARM and RISC V.


Towards Benchmarking the Utility of Explanations for Model Debugging. Post hoc explanation methods are an important class of approaches that help understand the rationale underlying a trained model's decision. But how useful are they for an end user towards accomplishing a given task? In this vision paper, we argue the need for a benchmark to facilitate evaluations of the utility of post hoc explanation methods. As a first step to this end, we enumerate desirable properties that such a benchmark should possess for the task of debugging text classifiers. Additionally, we highlight that such a benchmark facilitates not only assessing the effectiveness of explanations but also their efficiency.


Structural characteristics in network control of molecular multiplex networks. Numerous real world systems can be naturally modeled as multilayer networks, enabling an efficient way to characterize those complex systems. Much evidence in the context of system biology indicated that the collections between different molecular networks can dramatically impact the global network functions. Here, we focus on the molecular multiplex networks coupled by the transcriptional regulatory network (TRN) and protein protein interaction (PPI) network, exploring the controllability and energy requiring in these types of molecular multiplex networks. We find that the driver nodes tend to avoid essential or pathogen related genes. Yet, imposing the external inputs to these essential or pathogen related genes can remarkably reduce the energy cost, implying their crucial role in network control. Moreover, we find that lower minimal driver nodes as well as energy requiring are associated with disassortative coupling between TRN and PPI networks. Our findings in several species provide comprehensive understanding of genes' roles in biology and network control.


Non IID data and Continual Learning processes in Federated Learning A long road ahead. Federated Learning is a novel framework that allows multiple devices or institutions to train a machine learning model collaboratively while preserving their data private. This decentralized approach is prone to suffer the consequences of data statistical heterogeneity, both across the different entities and over time, which may lead to a lack of convergence. To avoid such issues, different methods have been proposed in the past few years. However, data may be heterogeneous in lots of different ways, and current proposals do not always determine the kind of heterogeneity they are considering. In this work, we formally classify data statistical heterogeneity and review the most remarkable learning strategies that are able to face it. At the same time, we introduce approaches from other machine learning frameworks, such as Continual Learning, that also deal with data heterogeneity and could be easily adapted to the Federated Learning settings.


A deep learning approach for inverse design of the metasurface for dual polarized waves. Compared to the conventional metasurface design, machine learning based methods have recently created an inspiring platform for an inverse realization of the metasurfaces. Here, we have used the Deep Neural Network (DNN) for the generation of desired output unit cell structures in an ultra wide working frequency band for both TE and TM polarized waves. To automatically generate metasurfaces in a wide range of working frequencies from 4 to 45 GHz, we deliberately design an 8 ring shaped pattern in such a way that the unit cells generated in the dataset can produce single or multiple notches in the desired working frequency band. Compared to the general approach, whereby the final metasurface structure may be formed by any randomly distributed "0" and "1", we propose here a restricted output structure. By restricting the output, the number of calculations will be reduced and the learning speed will be increased. Moreover, we have shown that the accuracy of the network reaches 91 . Obtaining the final unit cell directly without any time consuming optimization algorithms for both TE and TM polarized waves, and high average accuracy, promises an effective strategy for the metasurface design thus, the designer is required only to focus on the design goal.


GPSPiChain Blockchain based Self Contained Family Security System in Smart Home. With advancements in technology, personal computing devices are better adapted for and further integrated into people's lives and homes. The integration of technology into society also results in an increasing desire to control who and what has access to sensitive information, especially for vulnerable people including children and the elderly. With blockchain coming in to the picture as a technology that can revolutionise the world, it is now possible to have an immutable audit trail of locational data over time. By controlling the process through inexpensive equipment in the home, it is possible to control whom has access to such personal data. This paper presents a blockchain based family security system for tracking the location of consenting family members' smart phones. The locations of the family members' smart phones are logged and stored in a private blockchain which can be accessed through a node installed in the family home on a computer. The data for the whereabouts of family members stays within the family unit and does not go to any third party. The system is implemented in a small scale (one miner and two other nodes) and the technical feasibility is discussed along with the limitations of the system. Further research will cover the integration of the system into a smart home environment, and ethical implementations of tracking, especially of vulnerable people, using the immutability of blockchain.


Machine Covering in the Random Order Model. In the Online Machine Covering problem jobs, defined by their sizes, arrive one by one and have to be assigned to m parallel and identical machines, with the goal of maximizing the load of the least loaded machine. In this work, we study the Machine Covering problem in the recently popular random order model. Here no extra resources are present, but instead the adversary is weakened in that it can only decide upon the input set while jobs are revealed uniformly at random. It is particularly relevant to Machine Covering where lower bounds are usually associated to highly structured input sequences. We first analyze Graham's Greedy strategy in this context and establish that its competitive ratio decreases slightly to Theta left( frac m log(m) right) which is asymptotically tight. Then, as our main result, we present an improved tilde O ( sqrt 4 m ) competitive algorithm for the problem. This result is achieved by exploiting the extra information coming from the random order of the jobs, using sampling techniques to devise an improved mechanism to distinguish jobs that are relatively large from small ones. We complement this result with a first lower bound showing that no algorithm can have a competitive ratio of O left( frac log(m) log log(m) right) in the random order model. This lower bound is achieved by studying a novel variant of the Secretary problem, which could be of independent interest.


Partial Shattering for Permutations. Let S n be the set of all permutations of n 1, dotsc,n which we think of as fixed orderings of the elements 1, dotsc,n . We say mathcal S subseteq S n shatters a k set X subseteq n if all of the k! linear orderings of X appear in permutations from mathcal S . That is, there are k! permutations in mathcal S such that, when we restrict them to the elements of X , we get all possible linear orders of X . It is known, via a probabilistic argument, that the smallest mathcal S which shatters every k set has size Theta( log n) . We introduce a relaxation to determine the size of a family that covers at least t orders of every k tuple for different values of t leq k! . We show that when k 3 there are 3 possible size classes depending on t constant, Theta( log log n) , and Theta( log n) . We give a partial result on the analogue of this for k 3 , showing similar behaviour when t notin k 1, 2(k 1)! . We introduce a further variant to determine the largest number of k sets that can be totally shattered by a family with given size. For instance we show that with 6 permutations from S n , the proportion of triples shattered lies between frac 2 5 and frac 4 5 for n geq 5 . Finally we give an explicit construction for a family which shatters every k tuple and has size ( log n) c k .


Drone Control based on Mental Commands and Facial Expressions. When it is tried to control drones, there are many different ways through various devices, using either motions like facial motion, special gloves with sensors, red, green, blue cameras on the laptop or even using smartwatches by performing gestures that are picked up by motion sensors. The paper proposes a work on how drones could be controlled using brainwaves without any of those devices. The drone control system of the current research was developed using electroencephalogram signals took by an Emotiv Insight headset. The electroencephalogram signals are collected from the users brain. The processed signal is then sent to the computer via Bluetooth. The headset employs Bluetooth Low Energy for wireless transmission. The brain of the user is trained in order to use the generated electroencephalogram data. The final signal is transmitted to Raspberry Pi zero via the MQTT messaging protocol. The Raspberry Pi controls the movement of the drone through the incoming signal from the headset. After years, brain control can replace many normal input sources like keyboards, touch screens or other traditional ways, so it enhances interactive experiences and provides new ways for disabled people to engage with their surroundings.


Deep Convolutional Neural Networks for Onychomycosis Detection. The diagnosis of superficial fungal infections in dermatology is still mostly based on manual direct microscopic examination with Potassium Hydroxide (KOH) solution. However, this method can be time consuming and its diagnostic accuracy rates vary widely depending on the clinician's experience. With the increase of neural network applications in the field of clinical microscopy, it is now possible to automate such manual processes increasing both efficiency and accuracy. This study presents a deep neural network structure that enables the rapid solutions for these problems and can perform automatic fungi detection in grayscale images without dyes. 160 microscopic field photographs containing the fungal element, obtained from patients with onychomycosis, and 297 microscopic field photographs containing dissolved keratin obtained from normal nails were collected. Smaller patches containing 4234 fungi and 4981 keratin were extracted from these images. In order to detect fungus and keratin, VGG16 and InceptionV3 models were developed. The VGG16 model had 95.98 accuracy, and the area under the curve (AUC) value of 0.9930, while the InceptionV3 model had 95.90 accuracy and the AUC value of 0.9917. However, average accuracy and AUC value of clinicians is 72.8 and 0.87, respectively. This deep learning model allows the development of an automated system that can detect fungi within microscopic images.


The Spum and Sum diameter of Graphs Labelings of Sum Graphs. A sum graph is a finite simple graph whose vertex set is labeled with distinct positive integers such that two vertices are adjacent if and only if the sum of their labels is itself another label. The spum of a graph G is the minimum difference between the largest and smallest labels in a sum graph consisting of G and the minimum number of additional isolated vertices necessary so that a sum graph labeling exists. We investigate the spum of various families of graphs, namely cycles, paths, and matchings. We introduce the sum diameter, a modification of the definition of spum that omits the requirement that the number of additional isolated vertices in the sum graph is minimal, which we believe is a more natural quantity to study. We then provide asymptotically tight general bounds on both sides for the sum diameter, and study its behavior under numerous binary graph operations as well as vertex and edge operations. Finally, we generalize the sum diameter to hypergraphs.


Guided Imitation of Task and Motion Planning. While modern policy optimization methods can do complex manipulation from sensory data, they struggle on problems with extended time horizons and multiple sub goals. On the other hand, task and motion planning (TAMP) methods scale to long horizons but they are computationally expensive and need to precisely track world state. We propose a method that draws on the strength of both methods we train a policy to imitate a TAMP solver's output. This produces a feed forward policy that can accomplish multi step tasks from sensory data. First, we build an asynchronous distributed TAMP solver that can produce supervision data fast enough for imitation learning. Then, we propose a hierarchical policy architecture that lets us use partially trained control policies to speed up the TAMP solver. In robotic manipulation tasks with 7 DoF joint control, the partially trained policies reduce the time needed for planning by a factor of up to 2.6. Among these tasks, we can learn a policy that solves the RoboSuite 4 object pick place task 88 of the time from object pose observations and a policy that solves the RoboDesk 9 goal benchmark 79 of the time from RGB images (averaged across the 9 disparate tasks).


Rowmotion on fences. A fence is a poset with elements F x 1, x 2, ..., x n and covers x 1 x 2 ... x a x a 1 ... x b x b 1 ... where a, b, ... are positive integers. We investigate rowmotion on antichains and ideals of F. In particular, we show that orbits of antichains can be visualized using tilings. This permits us to prove various homomesy results for the number of elements of an antichain or ideal in an orbit. Rowmotion on fences also exhibits a new phenomenon, which we call orbomesy, where the value of a statistic is constant on orbits of the same size. Along the way, we prove a homomesy result for all self dual posets and show that any two Coxeter elements in certain toggle groups behave similarly with respect to homomesies which are linear combinations of ideal indicator functions. We end with some conjectures and avenues for future research.


Room temperature continuous wave upconversion white microlaser in a rare earth doped microcavity. White laser covering the visible color spectrum is critical in various applications including vivid display, holographic imaging and light based version of Wi Fi, but it is still challenging to realize the white microlaser due to the rigorous requirement in the balance between the optical gain and the feedback at different wavelengths. Here, we employ Tm, Er and Yb ions corporately for the upconversion white lasing in a single ultrahigh quality (Q) (up to 108) doped microcavity, where the thresholds of the red, green and blue lasers are about 90, 500 and 300 mu W, respectively. To the best of our knowledge, it is the first rare earth elements based room temperature, continuous wave white microlaser, which exhibits relatively stable chromaticity over 180 minutes, making it possible for practical applications.


Cohomology of smooth toric varieties naturality. Building on the recent computation of the cohomology rings of smooth toric varieties and partial quotients of moment angle complexes, we investigate the naturality properties of the resulting isomorphism between the cohomology of such a space and the torsion product involving the Stanley Reisner ring. If 2 is invertible in the chosen coefficient ring, then the isomorphism is natural with respect to toric morphisms, which for partial quotients are defined in analogy with toric varieties. In general there are deformation terms that we describe explicitly.


Numerical Solution and Bifurcation Analysis of Nonlinear Partial Differential Equations with Extreme Learning Machines. We address a new numerical scheme based on a class of machine learning methods, the so called Extreme Learning Machines with both sigmoidal and radial basis functions, for the computation of steady state solutions and the construction of (one dimensional) bifurcation diagrams of nonlinear partial differential equations (PDEs). For our illustrations, we considered two benchmark problems, namely (a) the one dimensional viscous Burgers with both homogeneous (Dirichlet) and non homogeneous mixed boundary conditions, and, (b) the one and two dimensional Liouville Bratu Gelfand PDEs with homogeneous Dirichlet boundary conditions. For the one dimensional Burgers and Bratu PDEs, exact analytical solutions are available and used for comparison purposes against the numerical derived solutions. Furthermore, the numerical efficiency (in terms of accuracy and size of the grid) of the proposed numerical machine learning scheme is compared against central finite differences (FD) and Galerkin weighted residuals finite element methods (FEM). We show that the proposed ELM numerical method outperforms both FD and FEM methods for medium to large sized grids, while provides equivalent results with the FEM for low to medium sized grids.


FiLMing Multimodal Sarcasm Detection with Attention. Sarcasm detection identifies natural language expressions whose intended meaning is different from what is implied by its surface meaning. It finds applications in many NLP tasks such as opinion mining, sentiment analysis, etc. Today, social media has given rise to an abundant amount of multimodal data where users express their opinions through text and images. Our paper aims to leverage multimodal data to improve the performance of the existing systems for sarcasm detection. So far, various approaches have been proposed that uses text and image modality and a fusion of both. We propose a novel architecture that uses the RoBERTa model with a co attention layer on top to incorporate context incongruity between input text and image attributes. Further, we integrate feature wise affine transformation by conditioning the input image through FiLMed ResNet blocks with the textual features using the GRU network to capture the multimodal information. The output from both the models and the CLS token from RoBERTa is concatenated and used for the final prediction. Our results demonstrate that our proposed model outperforms the existing state of the art method by 6.14 F1 score on the public Twitter multimodal sarcasm detection dataset.


Lifted MDS Codes over Finite Fields. MDS codes are elegant constructions in coding theory and have mode important applications in cryptography, network coding, distributed data storage, communication systems et. In this study, a method is given which MDS codes are lifted to a higher finite field. The presented method satisfies the protection of the distance and creating the MDS code over the F q by using MDS code over F p.


Jigsaw Large Language Models meet Program Synthesis. Large pre trained language models such as GPT 3, Codex, and Google's language model are now capable of generating code from natural language specifications of programmer intent. We view these developments with a mixture of optimism and caution. On the optimistic side, such large language models have the potential to improve productivity by providing an automated AI pair programmer for every programmer in the world. On the cautionary side, since these large language models do not understand program semantics, they offer no guarantees about quality of the suggested code. In this paper, we present an approach to augment these large language models with post processing steps based on program analysis and synthesis techniques, that understand the syntax and semantics of programs. Further, we show that such techniques can make use of user feedback and improve with usage. We present our experiences from building and evaluating such a tool jigsaw, targeted at synthesizing code for using Python Pandas API using multi modal inputs. Our experience suggests that as these large language models evolve for synthesizing code from intent, jigsaw has an important role to play in improving the accuracy of the systems.


More about sparse halves in triangle free graphs. One of Erdos's conjectures states that every triangle free graph on n vertices has an induced subgraph on n 2 vertices with at most n 2 50 edges. We report several partial results towards this conjecture. In particular, we establish the new bound frac 27 1024 n 2 on the number of edges in general case. We completely prove the conjecture for graphs of girth geq 5 , for graphs with independence number geq 2n 5 and for strongly regular graphs. Each of these three classes includes both known (conjectured) extremal configurations, the 5 cycle and the Petersen graph.


Blockchain Networks Data Structures of Bitcoin, Monero, Zcash, Ethereum, Ripple and Iota. Blockchain is an emerging technology that has enabled many applications, from cryptocurrencies to digital asset management and supply chains. Due to this surge of popularity, analyzing the data stored on blockchains poses a new critical challenge in data science. To assist data scientists in various analytic tasks on a blockchain, in this tutorial, we provide a systematic and comprehensive overview of the fundamental elements of blockchain network models. We discuss how we can abstract blockchain data as various types of networks and further use such associated network abstractions to reap important insights on blockchains' structure, organization, and functionality.


Jackson and Stechkin type inequalities for exponantial approximation of functions in some non translation invariant Banach spaces on the real line. Present work contains an elementary method to obtain Jackson and Stechkin type inequalities of approximation by integral functions of finite degree (IFFD) in some non translation invariant Banach spaces of functions defined on boldsymbol R left( infty , infty right) . To do this we employ a transference theorem which produce norm inequalities starting from norm inequalities in mathcal C ( boldsymbol R ) , the class of bounded uniformly continuous functions defined on boldsymbol R . As a model example we consider the variable exponent Lebesgue spaces. Let B subseteq boldsymbol R be a measurable set, p left( x right) B rightarrow lbrack 1, infty ) be a measurable function. For the class of functions f belonging to variable exponent Lebesgue spaces L p left( x right) left( B right) we consider difference operator left( I T delta right) r f left( cdot right) under the condition that p(x) satisfies the Log H " o lder continuity condition and 1 leq mathop rm ess inf limits nolimits x in B p(x) , mathop rm ess sup limits nolimits x in B p(x) infty where I is the identity operator, r in mathrm N left 1,2,3, cdots right , delta geq 0 and T delta is the forward Steklov operator. It is proved that left Vert left( I T delta right) r f right Vert p left( cdot right) is a suitable measure of smoothness for functions in L p left( x right) left( B right) where left Vert cdot right Vert p left( cdot right) is some norm in L p left( x right) left( B right) .


Optical power detector with broad spectral coverage, high detectivity and large dynamic range. Optical power measurements are needed in practically all technologies based on light. Here we report a general purpose optical power detector based on the photoacoustic effect. Optical power incident on the detector's black absorber produces an acoustic signal, which is further converted into an electrical signal using a silicon cantilever pressure transducer. We demonstrate an exceptionally large spectral coverage from ultraviolet to far infrared, with the possibility for further extension to the terahertz region. The linear dynamic range of the detector reaches 80 dB, ranging from a noise equivalent power of 6 nW to 600 mW.


pygrank A Python Package for Graph Node Ranking. We introduce pygrank, an open source Python package to define, run and evaluate node ranking algorithms. We provide object oriented and extensively unit tested algorithm components, such as graph filters, post processors, measures, benchmarks and online tuning. Computations can be delegated to numpy, tensorflow or pytorch backends and fit in back propagation pipelines. Classes can be combined to define interoperable complex algorithms. Within the context of this paper we compare the package with related alternatives and demonstrate its flexibility and ease of use with code examples.


Generating faster algorithms for d Path Vertex Cover. For a constant d , the d Path Vertex Cover problem ( d PVC) is as follows Given an undirected graph and an integer k , find a subset of at most k vertices of the graph, such that their deletion results in a graph not containing a path on d vertices as a subgraph. We develop a framework to automatically generate parameterized branching algorithms for the problem and obtain algorithms outperforming those previously known for 3 le d le 8 . E.g., we show that 5 PVC can be solved in O(2.7 k cdot n O(1) ) time.


Impact of spatial coarsening on Parareal convergence. We study the impact of spatial coarsening on the convergence of the Parareal algorithm, both theoretically and numerically. For initial value problems with a normal system matrix, we prove a lower bound for the Euclidean norm of the iteration matrix. When there is no physical or numerical diffusion, an immediate consequence is that the norm of the iteration matrix cannot be smaller than unoty as soon as the coarse problem has fewer degrees of freedom than the fine. This prevents a theoretical guarantee for monotonic convergence, which is necessary to obtain meaningful speedups. For diffusive problems, in the worst case where the iteration error contracts only as fast as the powers of the iteration matrix norm, making Parareal as accurate as the fine method will take about as many iterations as there are processors, making meaningful speedup impossible. Numerical examples with a non normal system matrix show that for diffusive problems good speedup is possible, but that for non diffusive problems the negative impact of spatial coarsening on convergence is big.


On the role of vorticity stretching and strain self amplification in the turbulence energy cascade. The tendency of turbulent flows to produce fine scale motions from large scale energy injection is often viewed as a scale wise cascade of kinetic energy driven by vorticity stretching. This has been recently evaluated by an exact, spatially local relationship Johnson, P. L. 2020, Phys. Rev. Lett., textbf 124 , 104501 , which also highlights the contribution of strain self amplification. In this paper, the role of these two mechanisms is explored in more detail. Vorticity stretching and strain amplification interactions between velocity gradients filtered at the same scale account for about half of the energy cascade rate, directly connecting restricted Euler dynamics to the energy cascade. Multiscale strain amplification and vorticity stretching are equally important, however, and more closely resemble eddy viscosity physics. Moreover, ensuing evidence of a power law decay of energy transfer contributions from disparate scales supports the notion of an energy cascade, albeit a leaky' one. Besides vorticity stretching and strain self amplification, a third mechanism of energy transfer is introduced and related to the vortex thinning mechanism important for the inverse cascade in two dimensions. Simulation results indicate this mechanism also provides a net source of backscatter in three dimensional turbulence, in the range of scales associated with the bottleneck effect. Taken together, these results provide a rich set of implications for large eddy simulation modeling.


A GNN RNN Approach for Harnessing Geospatial and Temporal Information Application to Crop Yield Prediction. Climate change is posing new challenges to crop related concerns including food insecurity, supply stability and economic planning. As one of the central challenges, crop yield prediction has become a pressing task in the machine learning field. Despite its importance, the prediction task is exceptionally complicated since crop yields depend on various factors such as weather, land surface, soil quality as well as their interactions. In recent years, machine learning models have been successfully applied in this domain. However, these models either restrict their tasks to a relatively small region, or only study over a single or few years, which makes them hard to generalize spatially and temporally. In this paper, we introduce a novel graph based recurrent neural network for crop yield prediction, to incorporate both geographical and temporal knowledge in the model, and further boost predictive power. Our method is trained, validated, and tested on over 2000 counties from 41 states in the US mainland, covering years from 1981 to 2019. As far as we know, this is the first machine learning method that embeds geographical knowledge in crop yield prediction and predicts the crop yields at county level nationwide. We also laid a solid foundation for the comparison with other machine learning baselines by applying well known linear models, tree based models, deep learning methods and comparing their performance. Experiments show that our proposed method consistently outperforms the existing state of the art methods on various metrics, validating the effectiveness of geospatial and temporal information.


Enhancing Adjoint Optimization based Photonics Inverse Design with Explainable Machine Learning. A fundamental challenge in the design of photonic devices, and electromagnetic structures more generally, is the optimization of their overall architecture to achieve a desired response. To this end, topology or shape optimizers based on the adjoint variables method have been widely adopted due to their high computational efficiency and ability to create complex freeform geometries. However, the functional understanding of such freeform structures remains a black box. Moreover, unless a design space of high performance devices is known in advance, such gradient based optimizers can get trapped in local minima valleys or saddle points, which limits performance achievable through this inverse design process. To elucidate the relationships between device performance and nanoscale structuring while mitigating the effects of local minima trapping, we present an inverse design framework that combines adjoint optimization, automated machine learning (AutoML), and explainable artificial intelligence (XAI). Integrated with a numerical electromagnetics simulation method, our framework reveals structural contributions towards a figure of merit (FOM) of interest. Through an explanation based reoptimization process, this information is then leveraged to minimize the FOM further than that obtained through adjoint optimization alone, thus overcoming the optimization's local minima. We demonstrate our framework in the context of waveguide design and achieve between 39 and 74 increases in device performance relative to state of the art adjoint optimization based inverse design across a range of telecom wavelengths. Results of this work therefore highlight machine learning strategies that can substantially extend and enhance the capabilities of a conventional, optimization based inverse design algorithm while revealing deeper insights into the algorithm's designs.


FedDropoutAvg Generalizable federated learning for histopathology image classification. Federated learning (FL) enables collaborative learning of a deep learning model without sharing the data of participating sites. FL in medical image analysis tasks is relatively new and open for enhancements. In this study, we propose FedDropoutAvg, a new federated learning approach for training a generalizable model. The proposed method takes advantage of randomness, both in client selection and also in federated averaging process. We compare FedDropoutAvg to several algorithms in an FL scenario for real world multi site histopathology image classification task. We show that with FedDropoutAvg, the final model can achieve performance better than other FL approaches and closer to a classical deep learning model that requires all data to be shared for centralized training. We test the trained models on a large dataset consisting of 1.2 million image tiles from 21 different centers. To evaluate the generalization ability of the proposed approach, we use held out test sets from centers whose data was used in the FL and for unseen data from other independent centers whose data was not used in the federated training. We show that the proposed approach is more generalizable than other state of the art federated training approaches. To the best of our knowledge, ours is the first study to use a randomized client and local model parameter selection procedure in a federated setting for a medical image analysis task.


Integrating Information Theory and Adversarial Learning for Cross modal Retrieval. Accurately matching visual and textual data in cross modal retrieval has been widely studied in the multimedia community. To address these challenges posited by the heterogeneity gap and the semantic gap, we propose integrating Shannon information theory and adversarial learning. In terms of the heterogeneity gap, we integrate modality classification and information entropy maximization adversarially. For this purpose, a modality classifier (as a discriminator) is built to distinguish the text and image modalities according to their different statistical properties. This discriminator uses its output probabilities to compute Shannon information entropy, which measures the uncertainty of the modality classification it performs. Moreover, feature encoders (as a generator) project uni modal features into a commonly shared space and attempt to fool the discriminator by maximizing its output information entropy. Thus, maximizing information entropy gradually reduces the distribution discrepancy of cross modal features, thereby achieving a domain confusion state where the discriminator cannot classify two modalities confidently. To reduce the semantic gap, Kullback Leibler (KL) divergence and bi directional triplet loss are used to associate the intra and inter modality similarity between features in the shared space. Furthermore, a regularization term based on KL divergence with temperature scaling is used to calibrate the biased label classifier caused by the data imbalance issue. Extensive experiments with four deep models on four benchmarks are conducted to demonstrate the effectiveness of the proposed approach.


Within Document Event Coreference with BERT Based Contextualized Representations. Event coreference continues to be a challenging problem in information extraction. With the absence of any external knowledge bases for events, coreference becomes a clustering task that relies on effective representations of the context in which event mentions appear. Recent advances in contextualized language representations have proven successful in many tasks, however, their use in event linking been limited. Here we present a three part approach that (1) uses representations derived from a pretrained BERT model to (2) train a neural classifier to (3) drive a simple clustering algorithm to create coreference chains. We achieve state of the art results with this model on two standard datasets for within document event coreference task and establish a new standard on a third newer dataset.


GLASS Geometric Latent Augmentation for Shape Spaces. We investigate the problem of training generative models on a very sparse collection of 3D models. We use geometrically motivated energies to augment and thus boost a sparse collection of example (training) models. We analyze the Hessian of the as rigid as possible (ARAP) energy to sample from and project to the underlying (local) shape space, and use the augmented dataset to train a variational autoencoder (VAE). We iterate the process of building latent spaces of VAE and augmenting the associated dataset, to progressively reveal a richer and more expressive generative space for creating geometrically and semantically valid samples. Our framework allows us to train generative 3D models even with a small set of good quality 3D models, which are typically hard to curate. We extensively evaluate our method against a set of strong baselines, provide ablation studies and demonstrate application towards establishing shape correspondences. We present multiple examples of interesting and meaningful shape variations even when starting from as few as 3 10 training shapes.


Stochastic sewing in Banach space. A stochastic sewing lemma which is applicable for processes taking values in Banach spaces is introduced. Applications to additive functionals of fractional Brownian motion of distributional type are discussed.


THUNDR Transformer based 3D HUmaN Reconstruction with Markers. We present THUNDR, a transformer based deep neural network methodology to reconstruct the 3d pose and shape of people, given monocular RGB images. Key to our methodology is an intermediate 3d marker representation, where we aim to combine the predictive power of model free output architectures and the regularizing, anthropometrically preserving properties of a statistical human surface model like GHUM a recently introduced, expressive full body statistical 3d human model, trained end to end. Our novel transformer based prediction pipeline can focus on image regions relevant to the task, supports self supervised regimes, and ensures that solutions are consistent with human anthropometry. We show state of the art results on Human3.6M and 3DPW, for both the fully supervised and the self supervised models, for the task of inferring 3d human shape, joint positions, and global translation. Moreover, we observe very solid 3d reconstruction performance for difficult human poses collected in the wild.


Signal Processing Challenges and Examples for it in situ Transmission Electron Microscopy. Transmission Electron Microscopy (TEM) is a powerful tool for imaging material structure and characterizing material chemistry. Recent advances in data collection technology for TEM have enabled high volume and high resolution data collection at a microsecond frame rate. Taking advantage of these advances in data collection rates requires the development and application of data processing tools, including image analysis, feature extraction, and streaming data processing techniques. In this paper, we highlight a few areas in materials science that have benefited from combining signal processing and statistical analysis with data collection capabilities in TEM and present a future outlook on opportunities of integrating signal processing with automated TEM data analysis.


Integrating Geometry Driven and Data Driven Positioning via Combinatorial Data Augmentation. Due to the emergence of various wireless sensing technologies, numerous positioning algorithms have been introduced in the literature, categorized into emph geometry driven positioning (GP) and emph data driven positioning (DP). These approaches have complementary limitations, e.g., a non line of sight issue for GP and the lack of a real time training dataset for DP, calling for combining the two for practical use. To this end, this paper aims at introducing a new principle, called emph combinatorial data augmentation (CDA), a catalyst for the two approaches' tight integration. Specifically, GP based datasets augmented from different combinations of positioning entities can be used as DP's inputs and labels. We confirm the CDA's effectiveness from field experiments based on WiFi emph round trip times (RTTs) and emph inertial measurement units (IMUs) by designing several CDA driven positioning algorithms. First, we show that CDA enables us to quantify the given position estimates' uncertainties. Then, we can filter out unreliable ones for WiFi RTT positioning and compute the covariance matrix of a Kalman filter to integrate two position estimates derived by WiFi RTT and IMUs. The mean and standard deviations of the resultant positioning error are 1.65 (m) and 1.01 (m), respectively. Next, we use the above position estimate to its real time label for emph fingerprint based positioning (FBP), shown to provide an acceptable positioning accuracy, say the average positioning error of 1.51 (m) with a standard deviation of 0.88 (m). Lastly, we discuss the proposed CDA's potential from positioning and beyond positioning perspectives.


A Study of Feature Selection and Extraction Algorithms for Cancer Subtype Prediction. In this work, we study and analyze different feature selection algorithms that can be used to classify cancer subtypes in case of highly varying high dimensional data. We apply three different feature selection methods on five different types of cancers having two separate omics each. We show that the existing feature selection methods are computationally expensive when applied individually. Instead, we apply these algorithms sequentially which helps in lowering the computational cost and improving the predictive performance. We further show that reducing the number of features using some dimension reduction techniques can improve the performance of machine learning models in some cases. We support our findings through comprehensive data analysis and visualization.


Optimal control problems with sparsity for phase field tumor growth models involving variational inequalities. This paper treats a distributed optimal control problem for a tumor growth model of Cahn Hilliard type including chemotaxis. The evolution of the tumor fraction is governed by a variational inequality corresponding to a double obstacle nonlinearity occurring in the associated potential. In addition, the control and state variables are nonlinearly coupled and, furthermore, the cost functional contains a nondifferentiable term like the L 1 norm in order to include sparsity effects which is of utmost relevance, especially time sparsity, in the context of cancer therapies as applying a control to the system reflects in exposing the patient to an intensive medical treatment. To cope with the difficulties originating from the variational inequality in the state system, we employ the so called "deep quench approximation" in which the convex part of the double obstacle potential is approximated by logarithmic functions. For such functions, first order necessary conditions of optimality can be established by invoking recent results. We use these results to derive corresponding optimality conditions also for the double obstacle case, by deducing a variational inequality in terms of the associated adjoint state variables. The resulting variational inequality can be exploited to also obtain sparsity results for the optimal controls.


On Symmetry and Quantification A New Approach to Verify Distributed Protocols. Proving that an unbounded distributed protocol satisfies a given safety property amounts to finding a quantified inductive invariant that implies the property for all possible instance sizes of the protocol. Existing methods for solving this problem can be described as search procedures for an invariant whose quantification prefix fits a particular template. We propose an alternative constructive approach that does not prescribe, a priori, a specific quantifier prefix. Instead, the required prefix is automatically inferred without any search by carefully analyzing the structural symmetries of the protocol. The key insight underlying this approach is that symmetry and quantification are closely related concepts that express protocol invariance under different re arrangements of its components. We propose symmetric incremental induction, an extension of the finite domain IC3 PDR algorithm, that automatically derives the required quantified inductive invariant by exploiting the connection between symmetry and quantification. While various attempts have been made to exploit symmetry in verification applications, to our knowledge, this is the first demonstration of a direct link between symmetry and quantification in the context of clause learning during incremental induction. We also describe a procedure to automatically find a minimal finite size, the cutoff, that yields a quantified invariant proving safety for any size. Our approach is implemented in IC3PO, a new verifier for distributed protocols that significantly outperforms the state of the art, scales orders of magnitude faster, and robustly derives compact inductive invariants fully automatically.


The limit as p rightarrow infty for the p Laplacian equation with dynamical boundary conditions. In this paper we study the limit as p to infty in the evolution problem driven by the p Laplacian with dynamical boundary conditions. We prove that the natural energy functional associated with this problem converges to a limit in the sense of Mosco convergence and as a consequence we obtain convergence of the solutions to the evolution problems. For the limit problem we show an interpretation in terms of optimal mass transportation and provide examples of explicit solutions for some particular data.


Edge Enriching Knowledge Graph Embeddings with External Text. Knowledge graphs suffer from sparsity which degrades the quality of representations generated by various methods. While there is an abundance of textual information throughout the web and many existing knowledge bases, aligning information across these diverse data sources remains a challenge in the literature. Previous work has partially addressed this issue by enriching knowledge graph entities based on "hard" co occurrence of words present in the entities of the knowledge graphs and external text, while we achieve "soft" augmentation by proposing a knowledge graph enrichment and embedding framework named Edge. Given an original knowledge graph, we first generate a rich but noisy augmented graph using external texts in semantic and structural level. To distill the relevant knowledge and suppress the introduced noise, we design a graph alignment term in a shared embedding space between the original graph and augmented graph. To enhance the embedding learning on the augmented graph, we further regularize the locality relationship of target entity based on negative sampling. Experimental results on four benchmark datasets demonstrate the robustness and effectiveness of Edge in link prediction and node classification.


The Eisenstein and winding elements of modular symbols for odd square free level. We explicitly write down the Eisenstein elements inside the space of modular symbols for Eisenstein series with integer coefficients for the congruence subgroups Gamma 0(N) with N odd square free. We also compute the winding elements explicitly for these congruence subgroups. This gives an answer to a question of Merel in these cases. Our results are explicit versions of the Manin Drinfeld Theorem Thm. 6 . These results are the generalization of the paper 1 results to odd square free level.


"ReLIC Reduced Logic Inference for Composition" for Quantifier Elimination based Compositional Reasoning and Verification. The paper presents our research on quantifier elimination (QE) for compositional reasoning and verification. For compositional reasoning, QE provides the foundation of our approach, serving as the calculus for composition to derive the strongest system property in a single step, from the given component atomic properties and their interconnection relation. We first developed this framework for time independent properties, and later extended it to time dependent property composition. The extension requires, in addition, shifting the given properties along time to span the time horizon of interest, he least of which for the strongest system property is no more than the total time horizons of the component level atomic properties. The system initial condition is also composed from atomic initial conditions of the components the same way. It is used to verify a desired system level property, alongside the derived strongest system property, by way of induction. Our composition approach is uniform regardless of the composition types (cascade parallel feedback) for both time dependent and time independent properties. We developed a new prototype verifier named ReLIC (Reduced Logic Inference for Composition) that implements our above approaches. We demonstrated it through several illustrative and practical examples. Further, we advanced the k induction based model checking with QE capabilities, by formulating its base and inductive steps into QE problems where all the variables are universally quantified. Our integration of the QE solver Redlog with the k induction based model checking tool JKind, shows the successful solving of a non linear problem that the SMT capable JKind failed to resolve. Finally, we also showcase the recent adoption of our approaches within an industrial V V tool suite for augmented static analysis of Simulink models and Deep Neural Networks (DNNs).


Probabilistic modeling of lake surface water temperature using a Bayesian spatio temporal graph convolutional neural network. Accurate lake temperature estimation is essential for numerous problems tackled in both hydrological and ecological domains. Nowadays physical models are developed to estimate lake dynamics however, computations needed for accurate estimation of lake surface temperature can get prohibitively expensive. We propose to aggregate simulations of lake temperature at a certain depth together with a range of meteorological features to probabilistically estimate lake surface temperature. Accordingly, we introduce a spatio temporal neural network that combines Bayesian recurrent neural networks and Bayesian graph convolutional neural networks. This work demonstrates that the proposed graphical model can deliver homogeneously good performance covering the whole lake surface despite having sparse training data available. Quantitative results are compared with a state of the art Bayesian deep learning method. Code for the developed architectural layers, as well as demo scripts, are available on https renkulab.io projects das bstnn.


Homothetic covering of convex hulls of compact convex sets. Let K be a compact convex set and m be a positive integer. The covering functional of K with respect to m is the smallest lambda in 0,1 such that K can be covered by m translates of lambda K . Estimations of the covering functionals of convex hulls of two or more compact convex sets are presented. It is proved that, if a three dimensional convex body K is the convex hull of two compact convex sets having no interior points, then the least number c(K) of smaller homothetic copies of K needed to cover K is not greater than 8 and c(K) 8 if and only if K is a parallelepiped.


The Power of Adaptivity for Stochastic Submodular Cover. In the stochastic submodular cover problem, the goal is to select a subset of stochastic items of minimum expected cost to cover a submodular function. Solutions in this setting correspond to sequential decision processes that select items one by one "adaptively" (depending on prior observations). While such adaptive solutions achieve the best objective, the inherently sequential nature makes them undesirable in many applications. We ask how well can solutions with only a few adaptive rounds approximate fully adaptive solutions? We give nearly tight answers for both independent and correlated settings, proving smooth tradeoffs between the number of adaptive rounds and the solution quality, relative to fully adaptive solutions. Experiments on synthetic and real datasets show qualitative improvements in the solutions as we allow more rounds of adaptivity in practice, solutions with a few rounds of adaptivity are nearly as good as fully adaptive solutions.


Artificial Intelligence Ethics and Safety practical tools for creating "good" models. The AI Robotics Ethics Society (AIRES) is a non profit organization founded in 2018 by Aaron Hui to promote awareness and the importance of ethical implementation and regulation of AI. AIRES is now an organization with chapters at universities such as UCLA (Los Angeles), USC (University of Southern California), Caltech (California Institute of Technology), Stanford University, Cornell University, Brown University, and the Pontifical Catholic University of Rio Grande do Sul (Brazil). AIRES at PUCRS is the first international chapter of AIRES, and as such, we are committed to promoting and enhancing the AIRES Mission. Our mission is to focus on educating the AI leaders of tomorrow in ethical principles to ensure that AI is created ethically and responsibly. As there are still few proposals for how we should implement ethical principles and normative guidelines in the practice of AI system development, the goal of this work is to try to bridge this gap between discourse and praxis. Between abstract principles and technical implementation. In this work, we seek to introduce the reader to the topic of AI Ethics and Safety. At the same time, we present several tools to help developers of intelligent systems develop "good" models. This work is a developing guide published in English and Portuguese. Contributions and suggestions are welcome.


Going Deeper Into Face Detection A Survey. Face detection is a crucial first step in many facial recognition and face analysis systems. Early approaches for face detection were mainly based on classifiers built on top of hand crafted features extracted from local image regions, such as Haar Cascades and Histogram of Oriented Gradients. However, these approaches were not powerful enough to achieve a high accuracy on images of from uncontrolled environments. With the breakthrough work in image classification using deep neural networks in 2012, there has been a huge paradigm shift in face detection. Inspired by the rapid progress of deep learning in computer vision, many deep learning based frameworks have been proposed for face detection over the past few years, achieving significant improvements in accuracy. In this work, we provide a detailed overview of some of the most representative deep learning based face detection methods by grouping them into a few major categories, and present their core architectural designs and accuracies on popular benchmarks. We also describe some of the most popular face detection datasets. Finally, we discuss some current challenges in the field, and suggest potential future research directions.


The Perils of Learning Before Optimizing. Formulating real world optimization problems often begins with making predictions from historical data (e.g., an optimizer that aims to recommend fast routes relies upon travel time predictions). Typically, learning the prediction model used to generate the optimization problem and solving that problem are performed in two separate stages. Recent work has showed how such prediction models can be learned end to end by differentiating through the optimization task. Such methods often yield empirical improvements, which are typically attributed to end to end making better error tradeoffs than the standard loss function used in a two stage solution. We refine this explanation and more precisely characterize when end to end can improve performance. When prediction targets are stochastic, a two stage solution must make an a priori choice about which statistics of the target distribution to model we consider expectations over prediction targets while an end to end solution can make this choice adaptively. We show that the performance gap between a two stage and end to end approach is closely related to the price of correlation concept in stochastic optimization and show the implications of some existing POC results for the predict then optimize problem. We then consider a novel and particularly practical setting, where multiple prediction targets are combined to obtain each of the objective function's coefficients. We give explicit constructions where (1) two stage performs unboundedly worse than end to end and (2) two stage is optimal. We use simulations to experimentally quantify performance gaps and identify a wide range of real world applications from the literature whose objective functions rely on multiple prediction targets, suggesting that end to end learning could yield significant improvements.