Second order step size tuning of SGD for non convex optimization. In view of a direct and simple improvement of vanilla SGD, this paper presents a fine tuning of its step sizes in the mini batch case. For doing so, one estimates curvature, based on a local quadratic model and using only noisy gradient approximations. One obtains a new stochastic first order method (Step Tuned SGD), enhanced by second order information, which can be seen as a stochastic version of the classical Barzilai Borwein method. Our theoretical results ensure almost sure convergence to the critical set and we provide convergence rates. Experiments on deep residual network training illustrate the favorable properties of our approach. For such networks we observe, during training, both a sudden drop of the loss and an improvement of test accuracy at medium stages, yielding better results than SGD, RMSprop, or ADAM.


Explicit topology optimization through moving node approach beam elements recognition. Structural optimization (topology, shapes, sizing) is an important tool for facilitating the emergence of new concepts in structural design. Normally, topology optimization is carried out at the early stage of design and then shape and sizing design are performed sequentially. Unlike traditional topology optimization method, explicit methodologies have attracted a great deal of attention because of the advantages of shortcuting the costly CAD CAE processes while dealing with low order number of design variables compared to implicit method (such as SIMP). This paper aims at presenting an adaptation of a flow inspired approach so called Moving Node Approach (MNA) in topology optimization. In this approach, the discretization is decoupled from the material distribution and the final objective is to recognize the best beam assembly while minimizing compliance. The paradigm has here changed and new design variables are used such as nodes location, elements length orientation and size providing a lower number of design variables than pixels based. The methodology is validated using 2 classical testcases in the field of Topology Optimization the Cantilever beam and the L Shape problem.


Dynamic imaging and characterization of volatile aerosols in e cigarette emissions using deep learning based holographic microscopy. Various volatile aerosols have been associated with adverse health effects however, characterization of these aerosols is challenging due to their dynamic nature. Here we present a method that directly measures the volatility of particulate matter (PM) using computational microscopy and deep learning. This method was applied to aerosols generated by electronic cigarettes (e cigs), which vaporize a liquid mixture (e liquid) that mainly consists of propylene glycol (PG), vegetable glycerin (VG), nicotine, and flavoring compounds. E cig generated aerosols were recorded by a field portable computational microscope, using an impaction based air sampler. A lensless digital holographic microscope inside this mobile device continuously records the inline holograms of the collected particles. A deep learning based algorithm is used to automatically reconstruct the microscopic images of e cig generated particles from their holograms, and rapidly quantify their volatility. To evaluate the effects of e liquid composition on aerosol dynamics, we measured the volatility of the particles generated by flavorless, nicotine free e liquids with various PG VG volumetric ratios, revealing a negative correlation between the particles' volatility and the volumetric ratio of VG in the e liquid. For a given PG VG composition, the addition of nicotine dominated the evaporation dynamics of the e cig aerosol and the aforementioned negative correlation was no longer observed. We also revealed that flavoring additives in e liquids significantly decrease the volatility of e cig aerosol. The presented holographic volatility measurement technique and the associated mobile device might provide new insights on the volatility of e cig generated particles and can be applied to characterize various volatile PM.


Stratified Homotopy Theory and a Whitehead Group for Stratified Spaces. In this master thesis, we extend results from classical simple homotopy theory to the world of stratified homotopy theory. To obtain a well established framework to work in, we prove a series of results on two model categories of simplicial sets and topological spaces, both equipped with a notion of filtration, introduced by Sylvain Douteau in his PHD thesis. In particular, we show that there is a fully faithful embedding of homotopy categories from the (finite) filtered simplicial into the filtered topological setting. We also use these results to characterize the morphisms in the topological filtered homotopy category between filtered spaces that are triangulable and stratified in some very general sense as stratified homotopy classes of stratum preserving maps. Then, moving on to simple homotopy theory, we propose a class of combinatorial elementary expansions for filtered simplicial sets that generalize both the classical ones as well as a class of stratified expansions suggested by Banagl et al. We show that they fulfill a series of axioms, suggested by Eckmann and Siebenmann for the construction of simple homotopy theory. In doing so, we obtain a combinatorially defined Whitehead group and torsion for filtered simplicial sets (and hence also for triangulable stratified spaces). We then begin a detailed investigation of their formal properties, proving for example that a Mayer Vietoris formula holds. Next, we apply our results on stratified homotopy theory to obtain a more topological description of the Whitehead group and to generalize the Whitehead torsion to arbitrary stratum preserving maps of triangulated filtered spaces. Finally, we prove that our simple homotopy theory is a generalization of the classical one, in the sense that it agrees with the latter when one considers trivially filtered simplicial sets as CW complexes.


Multi View Stereo with Transformer. This paper proposes a network, referred to as MVSTR, for Multi View Stereo (MVS). It is built upon Transformer and is capable of extracting dense features with global context and 3D consistency, which are crucial to achieving reliable matching for MVS. Specifically, to tackle the problem of the limited receptive field of existing CNN based MVS methods, a global context Transformer module is first proposed to explore intra view global context. In addition, to further enable dense features to be 3D consistent, a 3D geometry Transformer module is built with a well designed cross view attention mechanism to facilitate inter view information interaction. Experimental results show that the proposed MVSTR achieves the best overall performance on the DTU dataset and strong generalization on the Tanks Temples benchmark dataset.


Logarithmic Sobolev inequalities on Lie groups. In this paper we show a number of logarithmic inequalities on several classes of Lie groups log Sobolev inequalities on general Lie groups, log Sobolev (weighted and unweighted), log Gagliardo Nirenberg and log Caffarelli Kohn Nirenberg inequalities on graded Lie groups. Furthermore, on stratified groups, we show that one of the obtained inequalities is equivalent to a Gross type log Sobolev inequality with the horizontal gradient. As a result, we obtain the Gross log Sobolev inequality on general stratified groups but, bf very interestingly , with the Gaussian measure on the first stratum of the group. As another consequence we derive the Nash inequalities on graded groups and an example application to the decay rate for the heat equations for sub Laplacians on stratified groups. We also give weighted versions of log Sobolev and Nash inequalities for general Lie groups.


Self dual 2 quasi abelian Codes. A kind of self dual quasi abelian codes of index 2 over any finite field F is introduced. By counting the number of such codes and the number of the codes of this kind whose relative minimum weights are small, such codes are proved to be asymptotically good provided 1 is a square in F . Moreover, a kind of self orthogonal quasi abelian codes of index 2 are defined and such codes always exist. In a way similar to that for self dual quasi abelian codes of index 2 , it is proved that the kind of the self orthogonal quasi abelian codes of index 2 is asymptotically good.


OFF state trapping phenomena in GaN HEMTs interplay between gate trapping, acceptor ionization and positive charge redistribution. We present an extensive analysis of the trapping processes induced by drain bias stress in AlGaN GaN high electron mobility transistors (HEMTs) with p GaN gate. We demonstrate that (i) with increasing drain stress, pulsed I V and VTH measurements shown an initial positive VTH variation and an increase in RON then, for drain voltages 100 V, VTH is stable and the RON shows a partial recovery. (ii) At moderate voltages, VTH instability is related to trapping at the gate stack, due to residual negative charge left behind by the holes that leave the p GaN layer through the Schottky gate contact and or to trapping at the barrier. At higher voltages, we demonstrate the interplay of two trapping processes by C V and pulsed drain current analysis (iii) a fast storage of positive charge, accumulated near the buffer SRL interface, not strongly thermally activated, dominating at higher voltages (iv) a slower negative charge storage, thermally activated with activation energies for trapping and de trapping equal to 0.6 eV and 0.4 0.8 eV, respectively.


On managing vulnerabilities in AI ML systems. This paper explores how the current paradigm of vulnerability management might adapt to include machine learning systems through a thought experiment what if flaws in machine learning (ML) were assigned Common Vulnerabilities and Exposures (CVE) identifiers (CVE IDs)? We consider both ML algorithms and model objects. The hypothetical scenario is structured around exploring the changes to the six areas of vulnerability management discovery, report intake, analysis, coordination, disclosure, and response. While algorithm flaws are well known in the academic research community, there is no apparent clear line of communication between this research community and the operational communities that deploy and manage systems that use ML. The thought experiments identify some ways in which CVE IDs may establish some useful lines of communication between these two communities. In particular, it would start to introduce the research community to operational security concepts, which appears to be a gap left by existing efforts.


On a Poincar 'e Perron problem for high order differential equation. We address asymptotic formulae for the classical Poincar 'e Perron problem of linear differential equations with almost constant coefficients in a half line t 0, infty) for high order equation n ge 5 and some t 0 in mathbb R . By using a scalar nonlinear differential equation of Riccati type of order n 1 , we recover Poincar 'e's and Perron's results and provide asymptotic formulae with the aid of Bell's polynomials. Furthermore, we obtain some weaker versions of Levinson, Hartman Wintner and Harris Lutz type Theorems without the usual diagonalization process. For an arbitrary n ge 5 , these are corresponding versions to known results for cases n 2,3 and 4 .


grASP A Graph Based ASP Solver and Justification System. Answer set programming (ASP) is a popular nonmonotonic logic based paradigm for knowledge representation and solving combinatorial problems. Computing the answer set of an ASP program is NP hard in general, and researchers have been investing significant effort to speed it up. The majority of current ASP solvers employ SAT solver like technology to find these answer sets. As a result, justification for why a literal is in the answer set is hard to produce. There are dependency graph based approaches to find answer sets, but due to the representational limitations of dependency graphs, such approaches are limited. We propose a novel dependency graph based approach for finding answer sets in which conjunction of goals is explicitly represented as a node which allows arbitrary answer set programs to be uniformly represented. Our representation preserves causal relationships allowing for justification for each literal in the answer set to be elegantly found. Performance results from an implementation are also reported. Our work paves the way for computing answer sets without grounding a program.


Designing Approximately Optimal Search on Matching Platforms. We study the design of a decentralized two sided matching market in which agents' search is guided by the platform. There are finitely many agent types, each with (potentially random) preferences drawn from known type specific distributions. Equipped with knowledge of these distributions, the platform guides the search process by determining the meeting rate between each pair of types from the two sides. Focusing on symmetric pairwise preferences in a continuum model, we first characterize the unique stationary equilibrium that arises given a feasible set of meeting rates. We then introduce the platform's optimal directed search problem, which involves optimizing meeting rates to maximize equilibrium social welfare. We first show that incentive issues arising from congestion and cannibalization make the design problem fairly intricate. Nonetheless, we develop an efficiently computable search design whose corresponding equilibrium achieves at least 1 4 the social welfare of the optimal design. In fact, our construction always recovers at least 1 4 the first best social welfare, where agents' incentives are disregarded. Our directed search design is simple and easy to implement, as its corresponding bipartite graph consists of disjoint stars. Furthermore, our design implies the platform can substantially limit choice and yet induce an equilibrium with an approximately optimal welfare. Finally, we show that approximation is likely the best we can hope for by establishing that the problem of designing optimal directed search is NP hard to even approximate beyond a certain constant factor.


Kolmogorov's dissipation number and determining wavenumber for dyadic models. We study some dyadic models for incompressible magnetohydrodynamics and Navier Stokes equation. The existence of fixed point and stability of the fixed point are established. The scaling law of Kolmogorov's dissipation wavenumber arises from heuristic analysis. In addition, a time dependent determining wavenumber is shown to exist moreover, the time average of the determining wavenumber is proved to be bounded above by Kolmogorov's dissipation wavenumber. Additionally, based on the knowledge of the fixed point and stability of the fixed point, numerical simulations are performed to illustrate the energy spectrum in the inertial range below Kolmogorov's dissipation wavenumber.


Adaptive and Risk Aware Target Tracking with Heterogeneous Robot Teams. We consider a scenario where a team of robots with heterogeneous sensors must track a set of hostile targets which induce sensory failures on the robots. In particular, the likelihood of failures depends on the proximity between the targets and the robots. We propose a control framework that implicitly addresses the competing objectives of performance maximization and sensor preservation (which impacts the future performance of the team). Our framework consists of a predictive component which accounts for the risk of being detected by the target, and a reactive component which maximizes the performance of the team regardless of the failures that have already occurred. Based on a measure of the abundance of sensors in the team, our framework can generate aggressive and risk averse robot configurations to track the targets. Crucially, the heterogeneous sensing capabilities of the robots are explicitly considered in each step, allowing for a more expressive risk performance trade off. Simulated experiments with induced sensor failures demonstrate the efficacy of the proposed approach.


Symmetries in generalized Kaprekar routine. Algebraic relations are established that determine the invariance of the transformed number after several transformations. The restrictions that determine the group structure of these relationships are analyzed, as is the case of the Klein group. Parametric Kr functions associated with the existence of cycles are presented, as well as the role of the number of their links in the grouping of numbers in higher order equivalence classes. For this we have developed a methodology based on binary equivalence relations and the complete parameterization of the Kaprekar routine using Ki functions of parametric transformation.


Stress Testing of Meta learning Approaches for Few shot Learning. Meta learning (ML) has emerged as a promising learning method under resource constraints such as few shot learning. ML approaches typically propose a methodology to learn generalizable models. In this work in progress paper, we put the recent ML approaches to a stress test to discover their limitations. Precisely, we measure the performance of ML approaches for few shot learning against increasing task complexity. Our results show a quick degradation in the performance of initialization strategies for ML (MAML, TAML, and MetaSGD), while surprisingly, approaches that use an optimization strategy (MetaLSTM) perform significantly better. We further demonstrate the effectiveness of an optimization strategy for ML (MetaLSTM ) trained in a MAML manner over a pure optimization strategy. Our experiments also show that the optimization strategies for ML achieve higher transferability from simple to complex tasks.


Lower Bounds on Cross Entropy Loss in the Presence of Test time Adversaries. Understanding the fundamental limits of robust supervised learning has emerged as a problem of immense interest, from both practical and theoretical standpoints. In particular, it is critical to determine classifier agnostic bounds on the training loss to establish when learning is possible. In this paper, we determine optimal lower bounds on the cross entropy loss in the presence of test time adversaries, along with the corresponding optimal classification outputs. Our formulation of the bound as a solution to an optimization problem is general enough to encompass any loss function depending on soft classifier outputs. We also propose and provide a proof of correctness for a bespoke algorithm to compute this lower bound efficiently, allowing us to determine lower bounds for multiple practical datasets of interest. We use our lower bounds as a diagnostic tool to determine the effectiveness of current robust training methods and find a gap from optimality at larger budgets. Finally, we investigate the possibility of using of optimal classification outputs as soft labels to empirically improve robust training.


Optimized Deployment of Unmanned Aerial Vehicles for Wildfire Detection and Monitoring. In recent years, increased wildfires have caused irreversible damage to forest resources worldwide, threatening wildlives and human living conditions. The lack of accurate frontline information in real time can pose great risks to firefighters. Though a plethora of machine learning algorithms have been developed to detect wildfires using aerial images and videos captured by drones, there is a lack of methods corresponding to drone deployment. We propose a wildfire rapid response system that optimizes the number and relative positions of drones to achieve full coverage of the whole wildfire area. Trained on the data from historical wildfire events, our model evaluates the possibility of wildfires at different scales and accordingly allocates the resources. It adopts plane geometry to deploy drones while balancing the capability and safety with inequality constrained nonlinear programming. The method can flexibly adapt to different terrains and the dynamic extension of the wildfire area. Lastly, the operation cost under extreme wildfire circumstances can be assessed upon the completion of the deployment. We applied our model to the wildfire data collected from eastern Victoria, Australia, and demonstrated its great potential in the real world.


UniNet Unified Architecture Search with Convolution, Transformer, and MLP. Recently, transformer and multi layer perceptron (MLP) architectures have achieved impressive results on various vision tasks. A few works investigated manually combining those operators to design visual network architectures, and can achieve satisfactory performances to some extent. In this paper, we propose to jointly search the optimal combination of convolution, transformer, and MLP for building a series of all operator network architectures with high performances on visual tasks. We empirically identify that the widely used strided convolution or pooling based down sampling modules become the performance bottlenecks when the operators are combined to form a network. To better tackle the global context captured by the transformer and MLP operators, we propose two novel context aware down sampling modules, which can better adapt to the global information encoded by transformer and MLP operators. To this end, we jointly search all operators and down sampling modules in a unified search space. Notably, Our searched network UniNet (Unified Network) outperforms state of the art pure convolution based architecture, EfficientNet, and pure transformer based architecture, Swin Transformer, on multiple public visual benchmarks, ImageNet classification, COCO object detection, and ADE20K semantic segmentation.


Semi supervised Superpixel based Multi Feature Graph Learning for Hyperspectral Image Data. Graphs naturally lend themselves to model the complexities of Hyperspectral Image (HSI) data as well as to serve as semi supervised classifiers by propagating given labels among nearest neighbours. In this work, we present a novel framework for the classification of HSI data in light of a very limited amount of labelled data, inspired by multi view graph learning and graph signal processing. Given an a priori superpixel segmented hyperspectral image, we seek a robust and efficient graph construction and label propagation method to conduct semi supervised learning (SSL). Since the graph is paramount to the success of the subsequent classification task, particularly in light of the intrinsic complexity of HSI data, we consider the problem of finding the optimal graph to model such data. Our contribution is two fold firstly, we propose a multi stage edge efficient semi supervised graph learning framework for HSI data which exploits given label information through pseudo label features embedded in the graph construction. Secondly, we examine and enhance the contribution of multiple superpixel features embedded in the graph on the basis of pseudo labels in an extension of the previous framework, which is less reliant on excessive parameter tuning. Ultimately, we demonstrate the superiority of our approaches in comparison with state of the art methods through extensive numerical experiments.


On chip unidirectional waveguiding for surface acoustic waves along a defect line in a triangular lattice. The latest advances in topological physics have yielded a rich toolset to design highly robust wave transfer systems, for overcoming issues like beam steering and lateral diffraction in surface acoustic waves (SAWs). However, presently used designs for topologically protected SAWs have been largely limited to spin or valley polarized phases, which rely on non zero Berry curvature effects. Here we propose and experimentally demonstrate a highly robust SAW waveguide on lithium niobate (LiNbO3), based on a line defect within a true triangular phononic lattice, which instead employs an intrinsic chirality of phase vortices and maintains a zero Berry curvature. The guided SAW mode spans a wide bandwidth and shows confinement in the lateral direction with 3 dB attenuation within half of the unit cell length. SAW routing around sharp bends has been demonstrated in such waveguide, with less than 4 reflection per bend. The waveguide has also been found robust for defect lines with different configurations. The fully on chip system permits unidirectional SAW modes that are tightly bound to the waveguide, which provides a compact footprint ideal for miniaturization of practical applications and offers insight into the possibility of manipulating highly focused SAW propagation.


The cyclic graph of a semigroup. The cyclic graph Gamma(S) of a semigroup S is the simple graph whose vertex set is S and two vertices x, y are adjacent if the subsemigroup generated by x and y is monogenic. In this paper, we classify the semigroup S such that whose cyclic graph Gamma(S) is complete, bipartite, tree, regular and a null graph, respectively. Further, we determine the clique number of Gamma(S) for an arbitrary semigroup S . We obtain the independence number of Gamma(S) if S is a finite monogenic semigroup. At the final part of this paper, we give bounds for independence number of Gamma(S) if S is a semigroup of bounded exponent and we also characterize the semigroups attaining the bounds.


Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learning. Federated learning (FL) has gain growing interests for its capability of learning from distributed data sources collectively without the need of accessing the raw data samples across different sources. So far FL research has mostly focused on improving the performance, how the algorithmic disparity will be impacted for the model learned from FL and the impact of algorithmic disparity on the utility inconsistency are largely unexplored. In this paper, we propose an FL framework to jointly consider performance consistency and algorithmic fairness across different local clients (data sources). We derive our framework from a constrained multi objective optimization perspective, in which we learn a model satisfying fairness constraints on all clients with consistent performance. Specifically, we treat the algorithm prediction loss at each local client as an objective and maximize the worst performing client with fairness constraints through optimizing a surrogate maximum function with all objectives involved. A gradient based procedure is employed to achieve the Pareto optimality of this optimization problem. Theoretical analysis is provided to prove that our method can converge to a Pareto solution that achieves the min max performance with fairness constraints on all clients. Comprehensive experiments on synthetic and real world datasets demonstrate the superiority that our approach over baselines and its effectiveness in achieving both fairness and consistency across all local clients.


PokeBNN A Binary Pursuit of Lightweight Accuracy. Optimization of Top 1 ImageNet promotes enormous networks that may be impractical in inference settings. Binary neural networks (BNNs) have the potential to significantly lower the compute intensity but existing models suffer from low quality. To overcome this deficiency, we propose PokeConv, a binary convolution block which improves quality of BNNs by techniques such as adding multiple residual paths, and tuning the activation function. We apply it to ResNet 50 and optimize ResNet's initial convolutional layer which is hard to binarize. We name the resulting network family PokeBNN. These techniques are chosen to yield favorable improvements in both top 1 accuracy and the network's cost. In order to enable joint optimization of the cost together with accuracy, we define arithmetic computation effort (ACE), a hardware and energy inspired cost metric for quantized and binarized networks. We also identify a need to optimize an under explored hyper parameter controlling the binarization gradient approximation. We establish a new, strong state of the art (SOTA) on top 1 accuracy together with commonly used CPU64 cost, ACE cost and network size metrics. ReActNet Adam, the previous SOTA in BNNs, achieved a 70.5 top 1 accuracy with 7.9 ACE. A small variant of PokeBNN achieves 70.5 top 1 with 2.6 ACE, more than 3x reduction in cost a larger PokeBNN achieves 75.6 top 1 with 7.8 ACE, more than 5 improvement in accuracy without increasing the cost. PokeBNN implementation in JAX Flax and reproduction instructions are available in AQT repository https github.com google aqt


ODAM Object Detection, Association, and Mapping using Posed RGB Video. Localizing objects and estimating their extent in 3D is an important step towards high level 3D scene understanding, which has many applications in Augmented Reality and Robotics. We present ODAM, a system for 3D Object Detection, Association, and Mapping using posed RGB videos. The proposed system relies on a deep learning front end to detect 3D objects from a given RGB frame and associate them to a global object based map using a graph neural network (GNN). Based on these frame to model associations, our back end optimizes object bounding volumes, represented as super quadrics, under multi view geometry constraints and the object scale prior. We validate the proposed system on ScanNet where we show a significant improvement over existing RGB only methods.


Sparse Multi Term Disjunctive Cuts for the Epigraph of a Function of Binary Variables. We propose a new method for generating cuts valid for the epigraph of a function of binary variables. The proposed cuts are disjunctive cuts defined by many disjunctive terms obtained by enumerating a subset I of the binary variables. We show that by restricting the support of the cut to the same set of variables I , a cut can be obtained by solving a linear program with 2 I constraints. While this limits the size of the set I used to define the multi term disjunction, the procedure enables generation of multi term disjunctive cuts using far more terms than existing approaches. Experience on three MILP problems with block diagonal structure using I up to size 10 indicates the sparse cuts can often close nearly as much gap as the multi term disjunctive cuts without this restriction and in a fraction of the time.


Sectoral portfolio optimization by judicious selection of financial ratios via PCA. Embedding value investment in portfolio optimization models has always been a challenge. In this paper, we attempt to incorporate it by first employing principal component analysis (PCA) sector wise to filter out dominant financial ratios from each sector and thereafter, use the portfolio optimization model incorporating second order stochastic dominance (SSD) criteria to derive the final optimal investment. We consider a total of 11 well known financial ratios corresponding to each sector representing four categories of ratios, namely liquidity, solvency, profitability, and valuation. PCA is then applied sector wise over a period of 10 years from April 2004 to March 2014 to extract dominant ratios from each sector in two ways, one from the component solution and other from each category on the basis of their communalities. The two step Sectoral Portfolio Optimization (SPO) model integrating the SSD criteria in constraints is then utilized to build an optimal portfolio. The strategy formed using the former extracted ratios is termed as PCA SPO(A) and the latter one as PCA SPO(B). The results obtained from the proposed strategies are compared with the SPO model and two nominal SSD models, with and without financial ratios for computational study. Empirical performance of proposed strategies is assessed over the period of 6 years from April 2014 to March 2020 using a rolling window scheme with varying out of sample time line of 3, 6, 9, 12 and 24 months for S P BSE 500 market. We observe that the proposed strategy PCA SPO(B) outperforms all other models in terms of downside deviation, CVaR, VaR, Sortino ratio, Rachev ratio, and STARR ratios over almost all out of sample periods. This highlights the importance of value investment where ratios are carefully selected and embedded quantitatively in portfolio selection process.


Hate speech detection using static BERT embeddings. With increasing popularity of social media platforms hate speech is emerging as a major concern, where it expresses abusive speech that targets specific group characteristics, such as gender, religion or ethnicity to spread violence. Earlier people use to verbally deliver hate speeches but now with the expansion of technology, some people are deliberately using social media platforms to spread hate by posting, sharing, commenting, etc. Whether it is Christchurch mosque shootings or hate crimes against Asians in west, it has been observed that the convicts are very much influenced from hate text present online. Even though AI systems are in place to flag such text but one of the key challenges is to reduce the false positive rate (marking non hate as hate), so that these systems can detect hate speech without undermining the freedom of expression. In this paper, we use ETHOS hate speech detection dataset and analyze the performance of hate speech detection classifier by replacing or integrating the word embeddings (fastText (FT), GloVe (GV) or FT GV) with static BERT embeddings (BE). With the extensive experimental trails it is observed that the neural network performed better with static BE compared to using FT, GV or FT GV as word embeddings. In comparison to fine tuned BERT, one metric that significantly improved is specificity.


Plot2Spectra an Automatic Spectra Extraction Tool. Different types of spectroscopies, such as X ray absorption near edge structure (XANES) and Raman spectroscopy, play a very important role in analyzing the characteristics of different materials. In scientific literature, XANES Raman data are usually plotted in line graphs which is a visually appropriate way to represent the information when the end user is a human reader. However, such graphs are not conducive to direct programmatic analysis due to the lack of automatic tools. In this paper, we develop a plot digitizer, named Plot2Spectra, to extract data points from spectroscopy graph images in an automatic fashion, which makes it possible for large scale data acquisition and analysis. Specifically, the plot digitizer is a two stage framework. In the first axis alignment stage, we adopt an anchor free detector to detect the plot region and then refine the detected bounding boxes with an edge based constraint to locate the position of two axes. We also apply scene text detector to extract and interpret all tick information below the x axis. In the second plot data extraction stage, we first employ semantic segmentation to separate pixels belonging to plot lines from the background, and from there, incorporate optical flow constraints to the plot line pixels to assign them to the appropriate line (data instance) they encode. Extensive experiments are conducted to validate the effectiveness of the proposed plot digitizer, which shows that such a tool could help accelerate the discovery and machine learning of materials properties.


On the Dominant of the Multicut Polytope. Given a graph G (V,E) and a set S subseteq binom V 2 of terminal pairs, the minimum multicut problem asks for a minimum edge set delta subseteq E such that there is no s t path in G delta for any s,t in S . For S 1 this is the well known s t cut problem, but in general the minimum multicut problem is NP complete, even if the input graph is a tree. The multicut polytope text MultC square (G,S) is the convex hull of all multicuts in G the multicut dominant is given by text MultC (G,S) text MultC square (G,S) mathbb R E . The latter is the relevant object for the minimization problem. While polyhedra associated to several cut problems have been studied intensively there is only little knowledge for multicut. We investigate properties of the multicut dominant and in particular derive results on liftings of facet defining inequalities. This yields a classification of all facet defining path and edge inequalities. Moreover, we investigate the effect of graph operations such as node splitting, edge subdivisions, and edge contractions on the multicut dominant and its facet defining inequalities. In addition, we introduce facet defining inequalities supported on stars, trees, and cycles and show that the former two can be separated in polynomial time when the input graph is a tree.


BERT got a Date Introducing Transformers to Temporal Tagging. Temporal expressions in text play a significant role in language understanding and correctly identifying them is fundamental to various retrieval and natural language processing systems. Previous works have slowly shifted from rule based to neural architectures, capable of tagging expressions with higher accuracy. However, neural models can not yet distinguish between different expression types at the same level as their rule based counterparts. In this work, we aim to identify the most suitable transformer architecture for joint temporal tagging and type classification, as well as, investigating the effect of semi supervised training on the performance of these systems. Based on our study of token classification variants and encoder decoder architectures, we present a transformer encoder decoder model using the RoBERTa language model as our best performing system. By supplementing training resources with weakly labeled data from rule based systems, our model surpasses previous works in temporal tagging and type classification, especially on rare classes. Our code and pre trained experiments are available at https github.com satya77 Transformer Temporal Tagger


Dyadic models for ideal MHD. We study two dyadic models for incompressible ideal magnetohydrodynamics, one with a uni directional energy cascade and the other one with both forward and backward energy cascades. Global existence of weak solutions and local well posedness are established for both models. In addition, solutions to the model with uni directional energy cascade associated with positive initial data are shown to develop blow up at a finite time. Moreover, a set of fixed points is found for each model. Linear instability about some particular fixed points is proved.


Space Charge Driven Emittance Growth and the Effect of Octupoles in IOTA. The Integrable Optics Test Accelerator (IOTA) at Fermilab is a small machine dedicated to a broad frontier accelerator physics program. An important aspect of this program is to investigate the potential benefits of the resonance free tune spread achievable with integrable optics to store and accelerate high intensity proton beams for which space charge is significant. In this context, a good understanding of proton beam emittance growth and particle loss mechanisms is essential. Assuming nominal design parameters, simulations show that for a bunched beam, the bulk of emittance growth takes place immediately following injection, typically within tens of turns. We attempt to account for this growth using a simplified RMS mismatch theory some of its limitations and possible improvements are briefly discussed. We then compare theoretical predictions to simulations performed using the PIC code pyORBIT. Further exploring ways to mitigate emittance growth and reduce particle loss, we compare two beam matching strategies (1) matching at the injection point (2) matching at the center of the nonlinear (octupole) insertion region where beta x beta y . To observe how nonlinearity affects emittance growth and whether it dominates growth due to mismatch, we track two different distributions. Finally, we explore the potential of using octupoles in a quasi integrable configuration to mitigate growth using a variety of initial distributions both at reduced and full intensities.


On Exposing the Challenging Long Tail in Future Prediction of Traffic Actors. Predicting the states of dynamic traffic actors into the future is important for autonomous systems to operate safelyand efficiently. Remarkably, the most critical scenarios aremuch less frequent and more complex than the uncriticalones. Therefore, uncritical cases dominate the prediction. In this paper, we address specifically the challenging scenarios at the long tail of the dataset distribution. Our analysis shows that the common losses tend to place challenging cases suboptimally in the embedding space. As a consequence, we propose to supplement the usual loss with aloss that places challenging cases closer to each other. This triggers sharing information among challenging cases andlearning specific predictive features. We show on four public datasets that this leads to improved performance on the challenging scenarios while the overall performance stays stable. The approach is agnostic w.r.t. the used network architecture, input modality or viewpoint, and can be integrated into existing solutions easily. Code is available at https github.com lmb freiburg Contrastive Future Trajectory Prediction


Explicit Solving of the System of Natural PDEs of Minimal Lorentz Surfaces in mathbb R 4 2 . A minimal Lorentz surface in mathbb R 4 2 is said to be of general type if its corresponding null curves are non degenerate. These surfaces admit canonical isothermal and canonical isotropic coordinates. It is known that the Gauss curvature K and the normal curvature varkappa of such a surface considered as functions of the canonical coordinates satisfy a system of two natural PDEs. Using the Weierstrass type representations of the corresponding null curves, we solve explicitly the system of natural PDEs, expressing any solution by means of four real functions of one variable. We obtain the transformation formulas for the functions in the Weierstrass representation of a null curve under a proper motion in mathbb R 4 2 . Using this, we find the relation between two quadruples of real functions generating one and the same solution to the system of natural PDEs.


Identifying Misinformation from Website Screenshots. Can the look and the feel of a website give information about the trustworthiness of an article? In this paper, we propose to use a promising, yet neglected aspect in detecting the misinformativeness the overall look of the domain webpage. To capture this overall look, we take screenshots of news articles served by either misinformative or trustworthy web domains and leverage a tensor decomposition based semi supervised classification technique. The proposed approach i.e., VizFake is insensitive to a number of image transformations such as converting the image to grayscale, vectorizing the image and losing some parts of the screenshots. VizFake leverages a very small amount of known labels, mirroring realistic and practical scenarios, where labels (especially for known misinformative articles), are scarce and quickly become dated. The F1 score of VizFake on a dataset of 50k screenshots of news articles spanning more than 500 domains is roughly 85 using only 5 of ground truth labels. Furthermore, tensor representations of VizFake, obtained in an unsupervised manner, allow for exploratory analysis of the data that provides valuable insights into the problem. Finally, we compare VizFake with deep transfer learning, since it is a very popular black box approach for image classification and also well known text text based methods. VizFake achieves competitive accuracy with deep transfer learning models while being two orders of magnitude faster and not requiring laborious hyper parameter tuning.


Click to Move Controlling Video Generation with Sparse Motion. This paper introduces Click to Move (C2M), a novel framework for video generation where the user can control the motion of the synthesized video through mouse clicks specifying simple object trajectories of the key objects in the scene. Our model receives as input an initial frame, its corresponding segmentation map and the sparse motion vectors encoding the input provided by the user. It outputs a plausible video sequence starting from the given frame and with a motion that is consistent with user input. Notably, our proposed deep architecture incorporates a Graph Convolution Network (GCN) modelling the movements of all the objects in the scene in a holistic manner and effectively combining the sparse user motion information and image features. Experimental results show that C2M outperforms existing methods on two publicly available datasets, thus demonstrating the effectiveness of our GCN framework at modelling object interactions. The source code is publicly available at https github.com PierfrancescoArdino C2M.


Cross chain Interaction Model In a Fully Verified Way. There are different kinds of blockchains, which have been applied in various areas. Blockchains are relatively independent systems that are apt to form isolated data islands. Then cross chain interaction is proposed to connect different blockchains. However, the current cross chain methods do not maintain the security of the original blockchain. They either depend on a less secure third party system or a less secure method. This makes the cross chain interaction less secure than the original blockchains (the security downgrade issues), or the cross chain interaction can be done even if the paired blockchain does not exist (the blockchain invisible issue). In this paper, we first propose a system interaction model and use it to analyze the possible security issues. Based on conclusions got from the proposed model, we propose the cross chain method that verifies the data of the paired blockchain by the consensus algorithm of the paired blockchain (the CIFuV method). With this method, the cross chain interaction can be as the same security as in the paired blockchain. At last, we evaluate the security issues during the system interaction process, and the possibility to have the CIFuV model on the public blockchains.


On intersections of symmetric determinantal varieties and theta characteristics of canonical curves. From a block diagonal (n 1) times (m 1) times (m 1) tensor symmetric in the last two entries one obtains two varieties an intersection of symmetric determinantal hypersurfaces X in n dimensional projective space, and an intersection of quadrics mathfrak C in m dimensional projective space. Under mild technical assumptions, we characterize the accidental singularities of X in terms of mathfrak C . We apply our methods to algebraic curves and show how to construct theta characteristics of certain canonical curves of genera 3, 4, and 5, generalizing a classical construction of Cayley.


EEG connectivity A fundamental guide and checklist for optimal study design and evaluation. Brain connectivity can be estimated through a wide number of analyses applied to electroencephalographic (EEG) data. However, substantial heterogeneity in the implementation of connectivity methods exist. Heterogeneity in conceptualization of connectivity measures, data collection, or data pre processing may be associated with variability in robustness of measurement. While it is difficult to compare the results of studies using different EEG connectivity measures, standardization of processing and reporting may facilitate the task. We discuss how factors such as referencing, epoch length and number, controls for volume conduction, artefact removal, and statistical control of multiple comparisons influence the EEG connectivity estimate for connectivity measures, and what can be done to control for potential confounds associated with these factors. Based on the results reported in previous literature, this article presents recommendations and a novel checklist developed for quality assessment of EEG connectivity studies. This checklist and its recommendations are made in an effort to draw attention to factors that may influence connectivity estimates and factors that need to be improved in future research. Standardization of procedures and reporting in EEG connectivity may lead to EEG connectivity studies to be made more synthesisable and comparable despite variations in the methodology underlying connectivity estimates.


Recent Improvements in the Beam Capture at Fermilab Booster for High Intensity Operation. The Fermilab Booster uses multi turn beam injection with all its cavities phased such that beam sees a net zero RF voltage even when each station is at the same maxi mum voltage. During beam capture the RF voltage is increased slowly by using its paraphase system. At the end of the capture the feedback is turned on for beam acceleration. It is vital for present operations as well as during the PIP II era that both the HLRF and LLRF systems provide the proper intended phase and RF voltage to preserve the longitudinal emittance from injection to extraction. In this paper, we describe the original architecture of the cavity phase distribution, our recent beam based RF phase measurements, observed significant deviation in the relative phases between cavities and correction effort. Results from the improved capture for high intensity beam are also presented.


Exploiting Elasticity in Tensor Ranks for Compressing Neural Networks. Elasticities in depth, width, kernel size and resolution have been explored in compressing deep neural networks (DNNs). Recognizing that the kernels in a convolutional neural network (CNN) are 4 way tensors, we further exploit a new elasticity dimension along the input output channels. Specifically, a novel nuclear norm rank minimization factorization (NRMF) approach is proposed to dynamically and globally search for the reduced tensor ranks during training. Correlation between tensor ranks across multiple layers is revealed, and a graceful tradeoff between model size and accuracy is obtained. Experiments then show the superiority of NRMF over the previous non elastic variational Bayesian matrix factorization (VBMF) scheme.


Blockchain Gateways, Bridges and Delegated Hash Locks. In the current work we discuss the notion of gateways as a means for interoperability across different blockchain systems. We discuss two key principles for the design of gateway nodes and scalable gateway protocols, namely (i) the opaque ledgers principle as the analogue of the autonomous systems principle in IP datagram routing, and (ii) the externalization of value principle as the analogue of the end to end principle in the Internet architecture. We illustrate the need for a standard gateway protocol by describing a unidirectional asset movement protocol between two peer gateways, under the strict condition of both blockchains being private permissioned with their ledgers inaccessible to external entities. Several aspects of gateways and the gateway protocol is discussed, including gateway identities, gateway certificates and certificate hierarchies, passive locking transactions by gateways, and the potential use of delegated hash locks to expand the functionality of gateways.


Stable finite difference methods for Kirchhoff Love plates on overlapping grids. In this work, we propose and develop efficient and accurate numerical methods for solving the Kirchhoff Love plate model in domains with complex geometries. The algorithms proposed here employ curvilinear finite difference methods for spatial discretization of the governing PDEs on general composite overlapping grids. The coupling of different components of the composite overlapping grid is through numerical interpolations. However, interpolations introduce perturbation to the finite difference discretization, which causes numerical instability for time stepping schemes used to advance the resulted semi discrete system. To address the instability, we propose to add a fourth order hyper dissipation to the spatially discretized system to stabilize its time integration this additional dissipation term captures the essential upwinding effect of the original upwind scheme. The investigation of strategies for incorporating the upwind dissipation term into several time stepping schemes (both explicit and implicit) leads to the development of four novel algorithms. For each algorithm, formulas for determining a stable time step and a sufficient dissipation coefficient on curvilinear grids are derived by performing a local Fourier analysis. Quadratic eigenvalue problems for a simplified model plate in 1D domain are considered to reveal the weak instability due to the presence of interpolating equations in the spatial discretization. This model problem is further investigated for the stabilization effects of the proposed algorithms. Carefully designed numerical experiments are carried out to validate the accuracy and stability of the proposed algorithms, followed by two benchmark problems to demonstrate the capability and efficiency of our approach for solving realistic applications. Results that concern the performance of the proposed algorithms are also presented.


Topological characterizations of Morse Smale flows on surfaces and generic non Morse Smale flows. It is known that C r Morse Smale vector fields form an open dense subset in the space of vector fields on orientable closed surfaces and are structurally stable for any r in mathbb Z 0 . In particular, C r Morse vector fields (i.e. Morse Smale vector fields without limit cycles) form an open dense subset in the space of C r gradient vector fields on orientable closed surfaces and are structurally stable. Therefore generic time evaluations of gradient flows on orientable closed surfaces (e.g. solutions of differential equations) are described by alternating sequences of Morse flows and instantaneous non Morse gradient flows. To illustrate the generic transitions, we characterize and list all generic non Morse gradient flows. To construct such characterizations, we characterize isolated singular points of gradient flows on surfaces. In fact, such a singular point is a non trivial finitely sectored singular point without elliptic sectors. Moreover, considering Morse Smale flows as "generic gradient flows with limit cycles", we characterize and list all generic non Morse Smale flows.


Astrophysical explosions revisited collisionless coupling of debris to magnetized plasma. The coupling between a rapidly expanding cloud of ionized debris and an ambient magnetized plasma is revisited with a hybrid (kinetic ion fluid electron) simulation code that allows a study over a wide range of plasma parameters. Over a specified range of hypothetical conditions, simple scaling laws in terms of the total debris mass and explosion speed are derived and verified for the maximal size of the debris cloud and the fraction of debris that free streams from the burst along the magnetic field. The amount of debris that escapes from the burst with minimal coupling to the background magnetic field increases with the debris gyroradius. Test cases with two different debris species including a heavy minority species with a relatively large gyroradius highlight how the collisionless coupling of the debris depends on the single particle trajectories as well as the overall conservation of energy and momentum.


A Pilot Study on Detecting Unfairness in Human Decisions With Machine Learning Algorithmic Bias Detection. Fairness in decision making has been a long standing issue in our society. Despite the increasing number of research activities on unfairness mitigation in machine learning models, there is little research focusing on mitigating unfairness in human decisions. Fairness in human decisions is as important as, if not more important than, fairness in machine learning models since there are processes where humans make the final decisions and machine learning models can inherit bias from the human decisions they were trained on. As a result, this work aims to detect unfairness in human decisions, the very first step of solving the unfair human decision problem. This paper proposes to utilize the existing machine learning fairness detection mechanisms to detect unfairness in human decisions. The rationale behind this is, while it is difficult to directly test whether a human makes unfair decisions, with current research on machine learning fairness, it is now easy to test, on a large scale at a low cost, whether a machine learning model is unfair. By synthesizing unfair labels on four general machine learning fairness datasets and one image processing dataset, this paper shows that the proposed approach is able to detect (1) whether or not unfair labels exist in the training data and (2) the degree and direction of the unfairness. We believe that this work demonstrates the potential of utilizing machine learning fairness to detect human decision fairness. Following this work, research can be conducted on (1) preventing future unfair decisions, (2) fixing prior unfair decisions, and (3) training a fairer machine learning model.


"Don't Downvote A s!!" An Exploration of Reddit's Advice Communities. Advice forums are a crowdsourced way to reinforce cultural norms and moral behavior. Sites like Reddit contain massive amounts of natural language human interaction, with rules and norms unique to each individual subreddit community. To explore this data, we created a dataset with top 1000 posts from each of two such forums, r AmItheAsshole and r relationships, and extracted natural language features including sentiment, similarity, word frequency, and demographics using both algorithmic and manual methods. Further, we developed a method to extract demographic information from the subreddits, examined how the post authors' self disclosures reflect the unique communities in which their posts are shared, and discussed how the authors' language use choices might be related to broader social patterns. We observed some differences between the subreddits in terms of word frequency, demographics disclosure, and gendered language. In general, both subreddits had more female posters than male, and posters tended to use more words about their opposite gender than the same. Gender diverse posters were uncommon. Implications for future research include a more careful, inclusive focus on identity and disclosure and how that interacts with advice seeking behavior in online communities.


On Enriques Fano threefolds and a conjecture of Castelnuovo. Let W subset mathbb P 13 be the image of the rational map defined by the linear system of the sextic surfaces of mathbb P 3 having double points along the edges of a tetrahedron. Let mathcal L be the linear system of the hyperplane sections of W . It is known that a general S in mathcal L is an Enriques surface. The aim of this paper is to study the sublinear system mathcal L bullet subset mathcal L of the hyperplane sections of W having a triple point at a general point w in W . We will show that a general element of mathcal L bullet is birational to an elliptic ruled surface and that the image of W via the rational map defined by mathcal L bullet is a cubic Del Pezzo surface Delta subset mathbb P 3 with 4 nodes. Interestingly, this fact appears to be related to a conjecture of Castelnuovo.


Integer Programming for Causal Structure Learning in the Presence of Latent Variables. The problem of finding an ancestral acyclic directed mixed graph (ADMG) that represents the causal relationships between a set of variables is an important area of research on causal inference. Most existing score based structure learning methods focus on learning directed acyclic graph (DAG) models without latent variables. A number of score based methods have recently been proposed for the ADMG learning, yet they are heuristic in nature and do not guarantee an optimal solution. We propose a novel exact score based method that solves an integer programming (IP) formulation and returns a score maximizing ancestral ADMG for a set of continuous variables that follow a multivariate Gaussian distribution. We generalize the state of the art IP model for DAG learning problems and derive new classes of valid inequalities to formulate an IP model for ADMG learning. Empirically, our model can be solved efficiently for medium sized problems and achieves better accuracy than state of the art score based methods as well as benchmark constraint based methods.


Generalized Nonlocal Robin Laplacian on Arbitrary Domains. In this paper, we prove that it is always possible to define a realization of the Laplacian Delta kappa, theta on L 2( Omega) subject to nonlocal Robin boundary conditions with general jump measures on arbitrary open subsets of mathbb R N . This is made possible by using a capacity approach to define admissible pair of measures ( kappa, theta) that allows the associated form mathcal E kappa, theta to be closable. The nonlocal Robin Laplacian Delta kappa, theta generates a sub Markovian C 0 semigroup on L 2( Omega) which is not dominated by Neumann Laplacian semigroup unless the jump measure theta vanishes. Finally, the convergence of semigroups sequences e t Delta kappa n, theta n is investigated in the case of vague convergence and gamma convergence of admissible pair of measures ( kappa n, theta n) .


MMIU Dataset for Visual Intent Understanding in Multimodal Assistants. In multimodal assistant, where vision is also one of the input modalities, the identification of user intent becomes a challenging task as visual input can influence the outcome. Current digital assistants take spoken input and try to determine the user intent from conversational or device context. So, a dataset, which includes visual input (i.e. images or videos for the corresponding questions targeted for multimodal assistant use cases, is not readily available. The research in visual question answering (VQA) and visual question generation (VQG) is a great step forward. However, they do not capture questions that a visually abled person would ask multimodal assistants. Moreover, many times questions do not seek information from external knowledge. In this paper, we provide a new dataset, MMIU (MultiModal Intent Understanding), that contains questions and corresponding intents provided by human annotators while looking at images. We, then, use this dataset for intent classification task in multimodal digital assistant. We also experiment with various approaches for combining vision and language features including the use of multimodal transformer for classification of image question pairs into 14 intents. We provide the benchmark results and discuss the role of visual and text features for the intent classification task on our dataset.


Equivalent Versions of Total Flow Analysis. Total Flow Analysis (TFA) is a method for conducting the worst case analysis of time sensitive networks without cyclic dependencies. In networks with cyclic dependencies, Fixed Point TFA introduces artificial cuts, analyses the resulting cycle free network with TFA, and iterates. If it converges, it does provide valid performance bounds. We show that the choice of the specific cuts used by Fixed Point TFA does not affect its convergence nor the obtained performance bounds, and that it can be replaced by an alternative algorithm that does not use any cut at all, while still applying to cyclic dependencies.


GPT3 to plan Extracting plans from text using GPT 3. Operations in many essential industries including finance and banking are often characterized by the need to perform repetitive sequential tasks. Despite their criticality to the business, workflows are rarely fully automated or even formally specified, though there may exist a number of natural language documents describing these procedures for the employees of the company. Plan extraction methods provide us with the possibility of extracting structure plans from such natural language descriptions of the plans workflows, which could then be leveraged by an automated system. In this paper, we investigate the utility of generalized language models in performing such extractions directly from such texts. Such models have already been shown to be quite effective in multiple translation tasks, and our initial results seem to point to their effectiveness also in the context of plan extractions. Particularly, we show that GPT 3 is able to generate plan extraction results that are comparable to many of the current state of the art plan extraction methods.


DNA Assembled Multilayer Sliding Nanosystems. DNA nanotechnology allows for the realization of complex nanoarchitectures in which the spatial arrangements of different constituents and most functions can be enabled by DNA. When optically active components are integrated in such systems, the resulting nanoarchitectures not only provide great insights into the self assembly of nanoscale elements in a systematic way but also impart tailored optical functionality to DNA origami. In this Letter, we demonstrate DNA assembled multilayer nanosystems, which can carry out coordinated and reversible sliding motion powered by DNA fuels. Gold nanoparticles cross link DNA origami filaments to define the configurations of the multilayer nanoarchitectures as well as to mediate relative sliding between the neighboring origami filaments. Meanwhile, the gold nanoparticles serve as optical probes to dynamically interact with the fluorophores tethered on the filaments, rendering in situ detection of the stepwise sliding processes possible. This work seeds the basis to implement DNA assembled complex optical nanoarchitectures with programmability and addressability, advancing the field with new momentum.


Fast random number generator based on optical physical unclonable functions. We propose an approach for fast random number generation based on homemade optical physical unclonable functions (PUFs). The optical PUF is illuminated with input laser wavefront of continuous modulation to obtain different speckle patterns. Random numbers are fully extracted from speckle patterns through a simple post processing algorithm. Our proof of principle experiment achieves total random number generation rate of 0.96 Gbit s with verified randomness, which is far faster than previous optical PUF based schemes. Our results demonstrate that the presented random number generator (RNG) proposal has great potential to achieve ultrafast random number generation rate up to several hundreds of Gbit s.


Auxiliary Loss Reweighting for Image Inpainting. Image Inpainting is a task that aims to fill in missing regions of corrupted images with plausible contents. Recent inpainting methods have introduced perceptual and style losses as auxiliary losses to guide the learning of inpainting generators. Perceptual and style losses help improve the perceptual quality of inpainted results by supervising deep features of generated regions. However, two challenges have emerged with the usage of auxiliary losses (i) the time consuming grid search is required to decide weights for perceptual and style losses to properly perform, and (ii) loss terms with different auxiliary abilities are equally weighted by perceptual and style losses. To meet these two challenges, we propose a novel framework that independently weights auxiliary loss terms and adaptively adjusts their weights within a single training process, without a time consuming grid search. Specifically, to release the auxiliary potential of perceptual and style losses, we propose two auxiliary losses, Tunable Perceptual Loss (TPL) and Tunable Style Loss (TSL) by using different tunable weights to consider the contributions of different loss terms. TPL and TSL are supersets of perceptual and style losses and release the auxiliary potential of standard perceptual and style losses. We further propose the Auxiliary Weights Adaptation (AWA) algorithm, which efficiently reweights TPL and TSL in a single training process. AWA is based on the principle that the best auxiliary weights would lead to the most improvement in inpainting performance. We conduct experiments on publically available datasets and find that our framework helps current SOTA methods achieve better results.


Godot is not coming when we will let innovations enter psychiatry?. Current diagnostic practice in psychiatry is not relying on objective biophysical evidence. Recent pandemic emphasized the need to address the rising number of mood disorders (in particular, depression) cases in a more efficient way. We are proposing several already developed practices that can help improve that diagnostic process detection based on electrophysiological signals (both electroencephalogram and electrocardiogram based) that were shown to be accurate for clinical practice and several modalities of electromagnetic stimulation that were proven to ameliorate symptoms of depression. In this work, we are connecting the two with explanations coming from physiological complexity studies (and our own work) as well as advanced statistical methods like machine learning and the Bayesian inference approach. It is shown that fractal and nonlinear measures can adequately quantify previously undetected changes in intrinsic dynamics of physiological systems, providing the basis for early detection of depression. We are also advocating for early screening of cardiovascular risks in depression which is in connection to previously described decomplexification of the autonomous nervous system resulting in symptoms recognized clinically. All that said, additional information about the level of complexity can help clinicians make a better decisions in the therapeutic process, increase the overall effectiveness of the treatment, and finally increase the quality of life of the patient.


On the existence of graphs which can colour every regular graph. Let H and G be graphs. An H colouring of G is a map f E(G) rightarrow E(H) such that for any vertex u in V(G) there exists a vertex v in V(H) with f left ( partial G(u) right ) partial H(v) , where partial G(u) and partial H(v) respectively denote the sets of edges in G and H incident to the vertices u and v . If G admits an H colouring we say that H colours G . The question whether there exists a graph H that colours every bridgeless cubic graph G is addressed directly by the Petersen Colouring Conjecture, which states that the Petersen graph colours every bridgeless cubic graph. In 2012, Mkrtchyan showed that if this conjecture is true, the Petersen graph is the unique connected bridgeless cubic graph H which can colour all bridgeless cubic graphs G . In this paper we extend this and show that if we were to remove all degree conditions on H , every bridgeless cubic graph G can be coloured substantially only by a unique other graph the subcubic multigraph S 4 on four vertices. A few similar results are provided also under weaker assumptions on the graph G . In the second part of the paper, we also consider H colourings of regular graphs G having degree strictly greater than 3 and show that (i) for any r 3 , there does not exist a graph H (possibly containing parallel edges) that colours every r regular multigraph G , and (ii) for every r 1 , there does not exist a graph H (possibly containing parallel edges) that colours every 2r regular simple graph G .


F IDEs with Features and VCs Designed to Assist Human Reasoning When Verification Fails. This paper summarizes our efforts to aid human reasoning when verification fails through the use of two distinct Formalization Integrated Development Environments (F IDEs) that we have developed. Both environments are modular and facilitate reasoning about the full behavior of object based code. The first environment, referred to as the web IDE, has been used for several years to teach aspects of formal specification and verification, including why and where verification conditions (VCs) arise and how to use them when verification fails. The second F IDE, RESOLVE Studio, remains experimental, but is a more fully fledged environment backed by a sequent based VC generator that produces VCs with fewer extraneous givens. While the environments and VC generation techniques are necessarily language specific, the principles of alternative VC generation methods, F IDE features, and observations about their impact on novices and experienced users are more generally applicable.


A generalization of Sims conjecture for finite primitive groups and two point stabilizers in primitive groups. In this paper we propose a refinement of Sims conjecture concerning the cardinality of the point stabilizers in finite primitive groups and we make some progress towards this refinement. In this process, when dealing with primitive groups of diagonal type, we construct a finite primitive group G on Omega and two distinct points alpha, beta in Omega with G alpha beta unlhd G alpha and G alpha beta ne 1 , where G alpha is the stabilizer of alpha in G and G alpha beta is the stabilizer of alpha and beta in G . In particular, this example gives an answer to a question raised independently by Peter Cameron and by Alexander Fomin.


Restriction of exponential sums to hypersurfaces. We prove moment inequalities for exponential sums with respect to singular measures, whose Fourier decay matches those of curved hypersurfaces. Our emphasis will be on proving estimates that are sharp with respect to the scale parameter N , apart from N epsilon losses. In a few instances, we manage to remove these losses.


Heuristic Guided Reinforcement Learning. We provide a framework for accelerating reinforcement learning (RL) algorithms by heuristics constructed from domain knowledge or offline data. Tabula rasa RL algorithms require environment interactions or computation that scales with the horizon of the sequential decision making task. Using our framework, we show how heuristic guided RL induces a much shorter horizon subproblem that provably solves the original task. Our framework can be viewed as a horizon based regularization for controlling bias and variance in RL under a finite interaction budget. On the theoretical side, we characterize properties of a good heuristic and its impact on RL acceleration. In particular, we introduce the novel concept of an improvable heuristic, a heuristic that allows an RL agent to extrapolate beyond its prior knowledge. On the empirical side, we instantiate our framework to accelerate several state of the art algorithms in simulated robotic control tasks and procedurally generated games. Our framework complements the rich literature on warm starting RL with expert demonstrations or exploratory datasets, and introduces a principled method for injecting prior knowledge into RL.


Edge Vertex Dominating Set in Unit Disk Graphs. Given an undirected graph G (V,E) , a vertex v in V is edge vertex (ev) dominated by an edge e in E if v is either incident to e or incident to an adjacent edge of e . A set S ev subseteq E is an edge vertex dominating set (referred to as ev dominating set) of G if every vertex of G is ev dominated by at least one edge of S ev . The minimum cardinality of an ev dominating set is the ev domination number. The edge vertex dominating set problem is to find a minimum ev domination number. In this paper we prove that the ev dominating set problem is tt NP hard on unit disk graphs. We also prove that this problem admits a polynomial time approximation scheme on unit disk graphs. Finally, we give a simple 5 factor linear time approximation algorithm.


Bounds on the Feedback Capacity of the (d, infty) RLL Input Constrained Binary Erasure Channel. The paper considers the input constrained binary erasure channel (BEC) with causal, noiseless feedback. The channel input sequence respects the (d, infty) runlength limited (RLL) constraint, i.e., any pair of successive 1 s must be separated by at least d 0 s. We derive upper and lower bounds on the feedback capacity of this channel, for all d geq 1 , given by max limits delta in 0, frac 1 d 1 R( delta) leq C text fb (d infty) ( epsilon) leq max limits delta in 0, frac 1 1 d epsilon R( delta) , where the function R( delta) frac h b( delta) d delta frac 1 1 epsilon , with epsilon in 0,1 denoting the channel erasure probability, and h b( cdot) being the binary entropy function. We note that our bounds are tight for the case when d 1 (see Sabag et al. (2016)), and, in addition, we demonstrate that for the case when d 2 , the feedback capacity is equal to the capacity with non causal knowledge of erasures, for epsilon in 0,1 frac 1 2 log(3 2) . For d 1 , our bounds differ from the non causal capacities (which serve as upper bounds on the feedback capacity) derived in Peled et al. (2019) in only the domains of maximization. The approach in this paper follows Sabag et al. (2017), by deriving single letter bounds on the feedback capacity, based on output distributions supported on a finite Q graph, which is a directed graph with edges labelled by output symbols.


How Do Hyperedges Overlap in Real World Hypergraphs? Patterns, Measures, and Generators. Hypergraphs, a generalization of graphs, naturally represent groupwise relationships among multiple individuals or objects, which are common in many application areas, including web, bioinformatics, and social networks. The flexibility in the number of nodes in each hyperedge, which provides the expressiveness of hypergraphs, brings about structural differences between graphs and hypergraphs. Especially, the overlaps of hyperedges lead to complex high order relations beyond pairwise relations, raising new questions that have not been considered in graphs How do hyperedges overlap in real world hypergraphs? Are there any pervasive characteristics? What underlying process can cause such patterns? In this work, we closely investigate thirteen real world hypergraphs from various domains and share interesting observations of overlaps of hyperedges. To this end, we define principled measures and statistically compare the overlaps of hyperedges in real world hypergraphs and those in null models. Additionally, based on the observations, we propose HyperLap, a realistic hypergraph generative model. HyperLap is (a) Realistic it accurately reproduces overlapping patterns of real world hypergraphs, (b) Automatically Fittable its parameters can be tuned automatically using HyperLap to generate hypergraphs particularly similar to a given target hypergraph, (c) Scalable it generates and fits a hypergraph with 0.7 billion hyperedges within a few hours.


A Pub Sub Architecture to Promote Blockchain Interoperability. The maturing of blockchain technology leads to heterogeneity, where multiple solutions specialize in a particular use case. While the development of different blockchain networks shows great potential for blockchains, the isolated networks have led to data and asset silos, limiting the applications of this technology. Blockchain interoperability solutions are essential to enable distributed ledgers to reach their full potential. Such solutions allow blockchains to support asset and data transfer, resulting in the development of innovative applications. This paper proposes a novel blockchain interoperability solution for permissioned blockchains based on the publish subscribe architecture. We implemented a prototype of this platform to show the feasibility of our design. We evaluate our solution by implementing examples of the different publisher and subscriber networks, such as Hyperledger Besu, which is an Ethereum client, and two different versions of Hyperledger Fabric. We present a performance analysis of the whole network that indicates its limits and bottlenecks. Finally, we discuss the extensibility and scalability of the platform in different scenarios. Our evaluation shows that our system can handle a throughput in the order of the hundreds of transactions per second.


A convex function satisfying the Lojasiewicz inequality but failing the gradient conjecture both at zero and infinity. We construct an example of a smooth convex function on the plane with a strict minimum at zero, which is real analytic except at zero, for which Thom's gradient conjecture fails both at zero and infinity. More precisely, the gradient orbits of the function spiral around zero and at infinity. Besides, the function satisfies the Lojasiewicz gradient inequality at zero.


Sinoledge A Knowledge Engine based on Logical Reasoning and Distributed Micro Services. We propose a knowledge engine called Sinoledge mainly for doctors, physicians, and researchers in medical field to organize thoughts, manage reasoning process, test and deploy to production environments effortlessly. Our proposal can be related to rule engine usually used in business or medical fields. More importantly, our proposal provides a user friendly interface, an easy maintain way of organizing knowledge, an understandable testing functionality and a highly available and efficient back end architecture.


The Dean Kawasaki equation and the structure of density fluctuations in systems of diffusing particles. The Dean Kawasaki equation a strongly singular SPDE is a basic equation of fluctuating hydrodynamics it has been proposed in the physics literature to describe the fluctuations of the density of N independent diffusing particles in the regime of large particle numbers N gg 1 . The singular nature of the Dean Kawasaki equation presents a substantial challenge for both its analysis and its rigorous mathematical justification. Besides being non renormalisable by the theory of regularity structures by Hairer et al., it has recently been shown to not even admit nontrivial martingale solutions. In the present work, we give a rigorous and fully quantitative justification of the Dean Kawasaki equation by considering the natural regularisation provided by standard numerical discretisations We show that structure preserving discretisations of the Dean Kawasaki equation may approximate the density fluctuations of N non interacting diffusing particles to arbitrary order in N 1 (in suitable weak metrics). In other words, the Dean Kawasaki equation may be interpreted as a "recipe" for accurate and efficient numerical simulations of the density fluctuations of independent diffusing particles.


Rethinking Skip Connection with Layer Normalization in Transformers and ResNets. Skip connection, is a widely used technique to improve the performance and the convergence of deep neural networks, which is believed to relieve the difficulty in optimization due to non linearity by propagating a linear component through the neural network layers. However, from another point of view, it can also be seen as a modulating mechanism between the input and the output, with the input scaled by a pre defined value one. In this work, we investigate how the scale factors in the effectiveness of the skip connection and reveal that a trivial adjustment of the scale will lead to spurious gradient exploding or vanishing in line with the deepness of the models, which could be addressed by normalization, in particular, layer normalization, which induces consistent improvements over the plain skip connection. Inspired by the findings, we further propose to adaptively adjust the scale of the input by recursively applying skip connection with layer normalization, which promotes the performance substantially and generalizes well across diverse tasks including both machine translation and image classification datasets.


Autonomous Quadrotor Flight despite Rotor Failure with Onboard Vision Sensors Frames vs. Events. Fault tolerant control is crucial for safety critical systems, such as quadrotors. State of art flight controllers can stabilize and control a quadrotor even when subjected to the complete loss of a rotor. However, these methods rely on external sensors, such as GPS or motion capture systems, for state estimation. To the best of our knowledge, this has not yet been achieved with only onboard sensors. In this paper, we propose the first algorithm that combines fault tolerant control and onboard vision based state estimation to achieve position control of a quadrotor subjected to complete failure of one rotor. Experimental validations show that our approach is able to accurately control the position of a quadrotor during a motor failure scenario, without the aid of any external sensors. The primary challenge to vision based state estimation stems from the inevitable high speed yaw rotation (over 20 rad s) of the damaged quadrotor, causing motion blur to cameras, which is detrimental to visual inertial odometry (VIO). We compare two types of visual inputs to the vision based state estimation algorithm standard frames and events. Experimental results show the advantage of using an event camera especially in low light environments due to its inherent high dynamic range and high temporal resolution. We believe that our approach will render autonomous quadrotors safer in both GPS denied or degraded environments. We release both our controller and VIO algorithm open source.


Topologically trivial proper 2 knots. We study smooth, proper embeddings of noncompact surfaces in 4 manifolds, focusing on exotic planes and annuli, i.e., embeddings pairwise homeomorphic to the standard embeddings of R 2 and R 2 int D 2 in R 4. We encounter two uncountable classes of exotic planes, with radically different properties. One class is simple enough that we exhibit explicit level diagrams of them without 2 handles. Diagrams from the other class seem intractable to draw, and require infinitely many 2 handles. Every compact surface embedded rel nonempty boundary in the 4 ball has interior pairwise homeomorphic to infinitely many smooth, proper embeddings in R 4. The almost smooth, compact, embedded surfaces produced in 4 manifolds by Freedman theory have singularities requiring infinitely many local minima in their radial functions. There are exotic planes with uncountable groups acting isotopically essentially. This work raises many questions, some of which we list.


Transcription translation machinery an autocatalytic network coupling all cellular cycles and generating a plethora of growth laws. Recently discovered simple quantitative relations, known as bacterial growth laws, hint on the existence of simple underlying principles at the heart of bacterial growth. In this work, we provide a unifying picture on how these known relations, as well as new relations that we derive, stems from a universal autocatalytic network common to all bacteria, facilitating balanced exponential growth of individual cells. We show that the core of the cellular autocatalytic network is the transcription translation machinery in itself an autocatalytic network comprising several coupled autocatalytic cycles, including the ribosome, RNA polymerase, and tRNA charging cycles. We derive two types of growth laws per autocatalytic cycle, one relating growth rate to the relative fraction of the catalyst and its catalysis rate, and the other relating growth rate to all the time scales in the cycle. The structure of the autocatalytic network generates numerous regimes in state space, determined by the limiting components, while the number of growth laws can be much smaller. We also derive a growth law that accounts for the RNA polymerase autocatalytic cycle, which we use to explain how growth rate depends on the inducible expression of the rpoB and rpoC genes, which code for the RpoB and C protein subunits of RNA polymerase, and how the concentration of rifampicin, which targets RNA polymerase, affects growth rate without changing the RNA to protein ratio. We derive growth laws for tRNA synthesis and charging, and predict how growth rate depends on temperature, perturbation to ribosome assembly, and membrane synthesis.


Laser induced Coulomb explosion imaging of ce (C6H5Br)2 and ce C6H5Br I2 dimers in helium nanodroplets using the Timepix3. We have deduced the structure of the ce bromobenzene ce I2 heterodimer and the ce (bromobenzene)2 homodimer inside helium droplets using a combination of laser induced alignment, Coulomb explosion imaging, and three dimensional ion imaging. The complexes were fixed in a variety of orientations in the laboratory frame, then in each case multiply ionized by an intense laser pulse. A three dimensional ion imaging detector, including a Timepix3 detector allowed us to measure the correlations between velocity vectors of different fragments and, in conjunction with classical simulations, work backward to the initial structure of the complex prior to explosion. For the heterodimer, we find that the ce I2 molecular axis intersects the phenyl ring of the bromobenzene approximately perpendicularly. The homodimer has a stacked parallel structure, with the two bromine atoms pointing in opposite directions. These results illustrate the ability of Coulomb explosion imaging to determine the structure of large complexes, and point the way toward real time measurements of bimolecular reactions inside helium droplets.


Overcoming Poor Word Embeddings with Word Definitions. Modern natural language understanding models depend on pretrained subword embeddings, but applications may need to reason about words that were never or rarely seen during pretraining. We show that examples that depend critically on a rarer word are more challenging for natural language inference models. Then we explore how a model could learn to use definitions, provided in natural text, to overcome this handicap. Our model's understanding of a definition is usually weaker than a well modeled word embedding, but it recovers most of the performance gap from using a completely untrained word.


Real space density kernel method for Kohn Sham density functional theory calculations at high temperature. Kohn Sham density functional theory calculations using conventional diagonalization based methods become increasingly expensive as temperature increases due to the need to compute increasing numbers of partially occupied states. We present a density matrix based method for Kohn Sham calculations at high temperature that eliminates the need for diagonalization entirely, thus reducing the cost of such calculations significantly. Specifically, we develop real space expressions for the electron density, electronic free energy, Hellmann Feynman forces, and Hellmann Feynman stress tensor in terms of an orthonormal auxiliary orbital basis and its density kernel transform, the density kernel being the matrix representation of the density operator in the auxiliary basis. Using Chebyshev filtering to generate the auxiliary basis, we next develop an approach akin to Clenshaw Curtis spectral quadrature to calculate the individual columns of the density kernel based on the Fermi operator expansion in Chebyshev polynomials and employ a similar approach to evaluate band structure and entropic energy components. We implement the proposed formulation in the SPARC electronic structure code, using which we show systematic convergence of the aforementioned quantities to exact diagonalization results, and obtain significant speedups relative to conventional diagonalization based methods. Finally, we employ the new method to compute the self diffusion coefficient and viscosity of aluminum at 116,045 K from Kohn Sham quantum molecular dynamics, where we find agreement with previous more approximate orbital free density functional methods.


Deep learning based recognition of multi singularity structured light. Structured light with customized complex topological pattern inspires diverse classical and quantum investigations underpinned by accurate detection techniques. However, the current detection schemes are limited to vortex beam with simple phase singularity. The precise recognition of general structured light with multiple singularities remains elusive. Here, we report a deep learning (DL) framework that can unveil multi singularity phase structures in an end to end manner after feeding only two intensity patterns upon beam propagation captured via a camera, thus unleashing intuitive information of twisted photons. The DL toolbox can also acquire phases of Laguerre Gaussian (LG) modes with single singularity and other general phase objects likewise. Leveraging this DL platform, a phase based optical secret sharing (OSS) protocol is proposed, which is based on a more general class of multi singularity modes than conventional LG beams. The OSS protocol features strong security, wealthy state space and convenient intensity based measurements. This study opens new avenues for vortex beam communications, laser mode analysis, microscopy, Bose Einstein condensates characterization, etc.


Worst case Optimal Binary Join Algorithms under General ell p Constraints. Worst case optimal join algorithms have so far been studied in two broad contexts (1) when we are given input relation sizes Atserias et al., FOCS 2008, Ngo et al., PODS 2012, Velduizhen et. al, ICDT 2014 (2) when in addition to size, we are given a degree bound on the relation Abo Khamis et al., PODS 2017 . To the best of our knowledge, this problem has not been studied beyond these two statistics even for the case when input relations have arity (at most) two. In this paper, we present a worst case optimal join algorithm when are given ell p norm size bounds on input relations of arity at most two for p in (1, 2 . ( p 1 corresponds to relation size bounds and p infty corresponds to the degree bounds.) The worst case optimality holds any fixed p in (2, infty) as well (as long as the join query graph has large enough girth). Our algorithm is em simple , does not depend on p (or) the ell p norm bounds and avoids the (large) poly log factor associated with the best known algorithm PANDA Abo Khamis et al., PODS 2017 for the size and degree bounds setting of the problem. In this process, we (partially) resolve two open question from Ngo, 2018 Gems of PODS . We believe our algorithm has the em potential to pave the way for practical worst case optimal join algorithms beyond the case of size bounds.


Look Wide and Interpret Twice Improving Performance on Interactive Instruction following Tasks. There is a growing interest in the community in making an embodied AI agent perform a complicated task while interacting with an environment following natural language directives. Recent studies have tackled the problem using ALFRED, a well designed dataset for the task, but achieved only very low accuracy. This paper proposes a new method, which outperforms the previous methods by a large margin. It is based on a combination of several new ideas. One is a two stage interpretation of the provided instructions. The method first selects and interprets an instruction without using visual information, yielding a tentative action sequence prediction. It then integrates the prediction with the visual information etc., yielding the final prediction of an action and an object. As the object's class to interact is identified in the first stage, it can accurately select the correct object from the input image. Moreover, our method considers multiple egocentric views of the environment and extracts essential information by applying hierarchical attention conditioned on the current instruction. This contributes to the accurate prediction of actions for navigation. A preliminary version of the method won the ALFRED Challenge 2020. The current version achieves the unseen environment's success rate of 4.45 with a single view, which is further improved to 8.37 with multiple views.


Unobtrusive Pain Monitoring in Older Adults with Dementia using Pairwise and Contrastive Training. Although pain is frequent in old age, older adults are often undertreated for pain. This is especially the case for long term care residents with moderate to severe dementia who cannot report their pain because of cognitive impairments that accompany dementia. Nursing staff acknowledge the challenges of effectively recognizing and managing pain in long term care facilities due to lack of human resources and, sometimes, expertise to use validated pain assessment approaches on a regular basis. Vision based ambient monitoring will allow for frequent automated assessments so care staff could be automatically notified when signs of pain are displayed. However, existing computer vision techniques for pain detection are not validated on faces of older adults or people with dementia, and this population is not represented in existing facial expression datasets of pain. We present the first fully automated vision based technique validated on a dementia cohort. Our contributions are threefold. First, we develop a deep learning based computer vision system for detecting painful facial expressions on a video dataset that is collected unobtrusively from older adult participants with and without dementia. Second, we introduce a pairwise comparative inference method that calibrates to each person and is sensitive to changes in facial expression while using training data more efficiently than sequence models. Third, we introduce a fast contrastive training method that improves cross dataset performance. Our pain estimation model outperforms baselines by a wide margin, especially when evaluated on faces of people with dementia. Pre trained model and demo code available at https github.com TaatiTeam pain detection demo


GenTree Using Decision Trees to Learn Interactions for Configurable Software. Modern software systems are increasingly designed to be highly configurable, which increases flexibility but can make programs harder to develop, test, and analyze, e.g., how configuration options are set to reach certain locations, what characterizes the configuration space of an interesting or buggy program behavior? We introduce GenTree, a new dynamic analysis that automatically learns a program's interactions logical formulae that describe how configuration option settings map to code coverage. GenTree uses an iterative refinement approach that runs the program under a small sample of configurations to obtain coverage data uses a custom classifying algorithm on these data to build decision trees representing interaction candidates and then analyzes the trees to generate new configurations to further refine the trees and interactions in the next iteration. Our experiments on 17 configurable systems spanning 4 languages show that GenTree efficiently finds precise interactions using a tiny fraction of the configuration space.